-- Logs begin at Fri 2022-09-09 22:22:20 UTC, end at Fri 2022-09-09 23:20:43 UTC. -- Sep 09 22:53:50.690687 dv-cinder-852211-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 22:53:50.698320 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 22:53:50 2022] *** Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: nodename: dv-cinder-852211-14-iscsi Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: machine: x86_64 Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: clock source: unix Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: pcre jit disabled Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: detected number of CPU cores: 4 Sep 09 22:53:50.700381 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: current working directory: / Sep 09 22:53:50.701006 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: detected binary path: /usr/bin/uwsgi-core Sep 09 22:53:50.701006 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: your processes number limit is 47680 Sep 09 22:53:50.701006 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: your memory page size is 4096 bytes Sep 09 22:53:50.701006 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: detected max file descriptor number: 2048 Sep 09 22:53:50.701006 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: lock engine: pthread robust mutexes Sep 09 22:53:50.701006 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: thunder lock: enabled Sep 09 22:53:50.701006 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 22:53:50.701006 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 22:53:50.740565 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: Python main interpreter initialized at 0x55ae750a99c0 Sep 09 22:53:50.740565 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: python threads support enabled Sep 09 22:53:50.740565 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: your server socket listen backlog is limited to 100 connections Sep 09 22:53:50.740565 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: your mercy for graceful operations on workers is 90 seconds Sep 09 22:53:50.740891 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 22:53:50.741014 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: *** Operational MODE: preforking *** Sep 09 22:53:50.741276 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: *** uWSGI is running in multiple interpreter mode *** Sep 09 22:53:50.741276 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: spawned uWSGI master process (pid: 105418) Sep 09 22:53:50.741477 dv-cinder-852211-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 22:53:50.742305 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: spawned uWSGI worker 1 (pid: 105419, cores: 1) Sep 09 22:53:50.742422 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: spawned uWSGI worker 2 (pid: 105420, cores: 1) Sep 09 22:53:50.742572 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 22:53:51.388734 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 22:53:51.397327 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 22:53:52.458648 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 22:53:52.458648 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: from cryptography.utils import int_from_bytes Sep 09 22:53:52.459296 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 22:53:52.459296 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: from cryptography.utils import int_from_bytes Sep 09 22:53:52.461936 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 22:53:52.461936 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: from cryptography.utils import int_from_bytes Sep 09 22:53:52.462365 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 22:53:52.462365 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: from cryptography.utils import int_from_bytes Sep 09 22:53:54.940527 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 22:53:54.941190 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 22:53:54.941285 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 22:53:54.941625 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 22:53:54.941703 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 22:53:54.941792 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 22:53:54.941874 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 22:53:54.942033 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 22:53:54.942255 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.942361 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 22:53:54.942584 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.942696 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 22:53:54.942904 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.942998 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.943223 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.943333 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.943580 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.943697 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.943896 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.944008 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.944217 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.944395 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.944537 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.944629 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.944865 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.944959 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.945127 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.945225 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.945442 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.945533 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.945723 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.945808 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-14-iscsi {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.946033 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.946132 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.946352 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-14-iscsi {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.946452 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.946666 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.946765 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.946961 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.947045 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.947266 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.947356 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.947604 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.947705 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.947915 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.948061 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.948231 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.948408 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.948537 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.948849 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.949019 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.949147 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.949315 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.949468 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.949767 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.949908 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.949999 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.950125 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.950214 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.950408 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.950514 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.950729 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.950815 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.951038 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.951222 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.951363 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.951456 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.951700 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.951796 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.952010 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.952108 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-14-iscsi {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.952424 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-14-iscsi {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.952559 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.952736 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.952845 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.953045 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.953138 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.953350 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.953458 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.953753 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.953850 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.954060 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.954146 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.954365 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.954468 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.954677 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.954771 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.954996 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.955106 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.955296 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.955391 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.955636 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.955729 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.955950 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.956044 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.956264 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.956352 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.956571 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.956657 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.956866 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.956952 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.957170 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.957263 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.957474 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.957565 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.957785 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.957870 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.958083 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.958175 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.958335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.958421 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.958611 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.958708 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.958913 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.959006 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.959229 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.959315 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.959564 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.959666 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.959847 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.959939 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.960100 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.960188 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.960344 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.960431 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.960656 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.960748 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.960970 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.961057 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.961271 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.961358 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.961575 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.961661 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.961877 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.961986 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.962177 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.962264 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.962477 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.962617 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.962779 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.962878 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.963077 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.963171 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.963378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.963471 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.963715 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.963814 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.964023 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.964109 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.964336 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.964433 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.964640 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.964739 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.964953 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.965039 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.965277 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.965370 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.965575 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.965675 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.965878 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.965965 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.966207 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.966299 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.966518 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.966617 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.966817 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.966910 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.967130 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.967216 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.967447 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.967602 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.968279 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.968414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.968587 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.968680 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.968888 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.968982 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.969204 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.969301 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.969531 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.969615 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.969794 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.969886 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.970061 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.970151 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.970356 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.970520 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.970655 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.970747 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.970967 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.971053 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.971266 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.971368 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.971586 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.971676 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.971887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.971985 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.972183 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.972278 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.972483 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.972569 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.972780 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.972876 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.973080 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.973179 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.973378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.973464 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.973676 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.973762 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.973975 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.974069 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.974272 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.974357 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.974572 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.974661 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.974871 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.974958 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.975171 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.975256 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.975496 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.975590 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.975817 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.975909 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.976117 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.976203 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.976418 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.976514 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.976718 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.976813 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.977025 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.977111 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.977331 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.977423 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.977630 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.977726 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.977930 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.978016 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.978242 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.978333 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.978540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.978636 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.978838 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.978926 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.979150 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.979241 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.979450 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.979580 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.979772 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.979862 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.980084 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.980176 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.980380 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.980466 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.980680 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.980814 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.980992 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.981092 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.981290 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.981382 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.981588 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.981675 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.981883 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.982002 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.982181 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.982275 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.982479 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.982566 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.982777 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.982871 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.983072 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.983167 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.983368 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.984117 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.984255 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.984357 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.984569 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.984659 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.984885 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.984971 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.985190 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.985286 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.985494 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.985590 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.985792 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.985879 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.986106 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 22:53:54.986194 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.986437 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.986522 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.986765 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.986851 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.987098 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.987189 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.987409 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.987537 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.987760 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.987856 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.988086 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.988179 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.988396 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.988480 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.988703 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.988809 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.989011 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.989118 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.989332 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.989435 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.989635 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.989734 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.989940 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.990031 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.990245 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.990338 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.990556 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.990656 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.990868 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.991016 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.991189 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.991282 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.991511 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.991690 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.991825 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.991914 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.992135 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.992228 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.992440 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.992534 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.992749 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.992848 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.993070 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.993156 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.993380 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.993475 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.993684 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.993781 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.994026 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.994121 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.994355 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.994442 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.994666 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.994756 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.994984 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.995072 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.995296 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.995383 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.995635 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.995726 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.995943 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.996027 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.996251 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.996339 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.996581 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.996679 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.996893 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.996985 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.997201 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.997295 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.997511 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.997596 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.997816 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.997909 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.998132 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.998223 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.998441 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.998525 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.998743 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.998841 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.999076 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.999167 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.999388 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.999472 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.999718 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:54.999817 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.000047 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.000146 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.000357 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.000451 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.000671 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.000765 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.000978 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.001064 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.001284 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.001371 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.001595 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.001688 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.001899 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.001984 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.002207 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.002306 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.002511 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.002599 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.002810 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.002896 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.003111 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.003200 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.003410 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.003536 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.003737 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.003824 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.004037 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.004131 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.004354 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.004448 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.004666 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.004765 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.004965 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.005063 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.005291 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.005384 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.005595 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.005681 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.005902 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.005995 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.006203 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.006296 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.006507 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.006600 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.006807 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.006901 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.007113 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.007199 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.007418 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.007521 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.007775 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.007874 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.008091 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.008178 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.008402 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.008489 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.008710 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.008852 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.009022 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.009107 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.009320 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.009411 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.009621 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.009715 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.009927 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.010048 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.010232 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.010318 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.010539 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.010627 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.010846 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.010933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.011150 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.011235 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.011468 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.011621 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.011795 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.011883 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.012100 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.012186 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.012427 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.012526 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.012742 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.012828 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.013041 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.013135 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.013361 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.013458 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.013680 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.013767 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.013984 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.014079 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.014282 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.014366 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.014584 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.015218 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.015422 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.015542 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.015747 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.015834 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.016046 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.016133 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.016350 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.016448 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.016647 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.016740 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.016951 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.017036 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.017247 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.017340 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.017546 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.017633 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.017843 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.017929 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.018159 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.018255 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.018461 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.018547 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.018759 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.018844 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.019057 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.019196 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.019354 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.019541 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.019712 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.019853 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.020013 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.020175 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.020336 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.020468 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.020665 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.020878 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.021014 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.021149 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.021284 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.021417 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.021576 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.021722 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.021886 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.022032 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.022188 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.022324 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.022493 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.022644 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.022800 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.022950 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.023106 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.023240 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.023419 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.023545 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.023749 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.023837 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.024064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.024150 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.024370 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.024466 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.024686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.024779 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.024989 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.025083 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.025302 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.025435 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.025599 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.025695 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.025908 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.025995 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.026244 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.026331 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.026570 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.026656 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.026885 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.026970 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.027196 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.027281 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.027551 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.027643 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.027829 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.027918 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.028135 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.028229 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.028440 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.028533 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.028746 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.028842 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.029050 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.029136 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.029361 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.029453 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.029662 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.029760 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.029971 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.030057 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.030291 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.030948 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.031128 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.031224 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.031433 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.031537 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.031767 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.031864 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.032068 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.032164 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.032374 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.032461 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.032695 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.032790 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.033020 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.033113 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.033321 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.033406 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.033628 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.033721 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.033942 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.034028 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.034247 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.034331 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.034552 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.034652 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.034860 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.034946 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.035158 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.035243 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.035458 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.035579 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.035787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.035883 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.036097 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.036183 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.036402 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.036499 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.036708 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.036795 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.037015 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.037107 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.037324 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.037419 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.037628 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.037714 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.037929 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.038017 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.038227 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.038322 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.038532 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.038618 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.038847 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.038933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.039153 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.039250 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.039469 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.039576 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.039808 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.039894 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.040111 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.040211 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.040412 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.040509 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.040727 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.040813 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.041031 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.041119 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.041340 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.041429 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.041632 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.041736 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.041930 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.042025 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.042266 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.042352 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.042570 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.042654 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.042868 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.042954 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.043176 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.043261 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.043530 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.043638 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.043817 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.043911 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.044123 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.044209 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.044430 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.044544 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.044733 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.044826 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.045048 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.045134 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.045620 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.045771 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.045947 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.046033 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.046256 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.046349 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.046564 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.046660 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.046874 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.046968 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.047177 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.047264 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.047514 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.047628 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.047820 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.047907 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.048126 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.048213 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.048433 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.048526 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.048733 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.048819 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.049039 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.049125 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.049351 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.049610 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.049898 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.049985 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.050228 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.050315 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.050541 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.050633 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.050856 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.050942 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.051200 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.051301 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.051534 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.051626 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.051863 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.051952 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.052186 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.052272 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.052497 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.052582 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.052797 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.052883 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.053101 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.053188 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.053405 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.053529 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.053704 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.053796 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.054009 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.054095 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.054309 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.054395 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.054610 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.054704 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.054912 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.054998 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.055216 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.055310 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.055535 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.055636 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.055842 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.055972 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.056140 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.056246 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.056442 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.056530 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.056747 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.056831 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.057051 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.057145 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.057357 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.057443 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.057656 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.057747 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.057973 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.058068 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.058278 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.058362 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.058574 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.058659 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.058873 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.058959 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.059172 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.059270 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.059523 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.059670 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.059820 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.059954 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.060147 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.060281 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.060471 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.060613 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.060807 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.060941 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.061111 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.061248 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.061413 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.061561 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.061757 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.061895 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.062062 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.062194 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.062365 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.062511 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.062655 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.062797 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.062957 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.063093 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.063261 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.063405 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.063580 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.063715 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.063887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.064024 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.064191 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.064343 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.064478 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.064628 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.064774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.064909 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.065051 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.065186 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.065358 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.065496 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.065656 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.065792 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.065954 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.066051 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.066257 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.066345 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.066556 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.066652 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.066860 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.066947 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.067162 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.067249 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.067464 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.067594 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.067783 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.067871 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.068089 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.068176 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.068384 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.068470 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.068697 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.068785 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.068996 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.069090 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.069295 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.069390 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.069594 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.069696 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.069897 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.069984 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.070199 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.070299 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.070497 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.070592 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.070815 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.070910 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.071117 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.071213 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.071412 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.071526 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.071735 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.071823 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.072038 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.072137 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.072336 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.072429 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.072636 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.072724 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.072938 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.073027 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.073255 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.073342 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.073561 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.073646 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.073860 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.073948 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.074165 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.074250 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.074462 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.074555 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.074763 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.074851 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.075063 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.075148 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.075365 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.075451 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.075684 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.075772 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.075985 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.076088 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.076281 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.076382 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.076580 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.076667 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.076884 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.076972 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.077712 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.077814 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.078016 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.078102 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.078318 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.078404 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.078618 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.078713 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.078918 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.079006 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.079249 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.079341 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.079567 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.079702 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.079920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.080008 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.080222 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.080311 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.080530 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.080625 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.080840 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.080929 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.081144 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.081229 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.081449 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.081537 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.081752 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.081838 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.082051 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.082137 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.082362 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.082450 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.082669 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.082755 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.082972 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.083057 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.083272 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.083396 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.083594 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.083683 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.083914 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.084018 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.084222 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.084316 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.084525 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.084619 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.084842 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.084942 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.085161 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.085249 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.085467 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.085560 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.085772 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.085866 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.086080 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.086169 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.086385 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.086471 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.086687 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.086781 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.086998 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.087085 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.087305 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.087390 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.087638 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.087785 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.087952 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.088039 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.088259 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.088345 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.088566 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.088654 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.088870 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.088963 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.089169 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.089273 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.089476 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.089573 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.089781 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.089875 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.090081 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.090174 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.090401 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.090495 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.090705 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.090826 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.091006 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.091106 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.091312 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.091397 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.091640 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.091729 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.091948 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.092045 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.092250 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.092374 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.092671 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.092766 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.093514 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.093614 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.093823 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.093959 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.094128 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.094223 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.094434 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.094529 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.094741 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.094835 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.095052 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.095137 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.095359 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.095453 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.095682 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.095807 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.096096 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.096231 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.096406 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.096494 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.096717 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.096804 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.097022 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.097107 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.097322 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.097416 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.097624 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.097717 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.097931 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.098017 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.098240 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.098327 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.098539 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.098624 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.098841 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.098936 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.099143 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.099230 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.099454 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.099559 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.099776 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.099920 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.100093 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.100211 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.100506 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.100592 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.100814 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.100946 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.101116 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.101227 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.101523 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.101610 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.101829 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.101924 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.102135 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.102234 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.102453 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.102540 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.102769 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.102857 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.103075 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.103169 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.103378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.103468 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.103712 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.103799 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.104016 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.104116 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.104336 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.104435 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.104655 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.104743 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.104964 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.105051 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.105275 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.105362 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.105577 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.105663 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.105894 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.105989 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.106212 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.106348 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.106518 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.106606 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.106842 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.106930 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.107246 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.107332 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.107583 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.107688 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.107892 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.107986 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.108210 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.108304 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.108555 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.108658 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.108859 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.108946 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.109162 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.109256 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.109468 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.109563 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.109768 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.109862 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.110070 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.110167 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.110389 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.110487 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.110690 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.110783 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.110997 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.111092 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.111305 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.111391 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.111635 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.111725 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.111940 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.112038 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.112242 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.112330 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.112559 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.112645 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.112858 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.112951 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.113179 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.113266 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.113491 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.113578 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.113811 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.113897 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.114122 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.114212 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.114422 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.114509 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.114739 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.114838 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.115044 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.115130 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.115342 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.115427 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.115664 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.115769 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.115966 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.116059 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.116303 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.116465 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.116610 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.116752 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.116897 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.117033 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.117221 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.117359 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.117546 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.117692 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.117838 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.117976 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.118167 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.118301 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.118486 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.118619 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.118801 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.118939 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.119105 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.119249 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.119416 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.119593 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.119758 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.119895 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.120058 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.120189 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.120358 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.120496 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.120661 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.120797 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.120958 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.121102 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.121323 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.121461 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.121595 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.121730 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.121869 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.122014 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.122155 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.122295 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.122435 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.122570 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.122703 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.122844 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.122979 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.123125 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.123258 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.123392 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.123598 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.123747 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.123904 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.124063 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.124233 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.124351 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.124533 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.124636 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.124832 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.124926 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.125167 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.125255 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.125468 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.125554 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.125790 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.125888 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.126097 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.126182 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.126434 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.126529 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.126730 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.126833 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.127044 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.127129 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.127350 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.127436 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.127682 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.127781 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.127993 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.128079 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.128302 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.128391 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.128610 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.128694 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.128909 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.129003 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.129218 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.129306 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.129526 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.129624 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.129837 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.130057 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.130344 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.130440 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.130669 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.130759 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.130978 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.131091 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.131290 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.131397 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.131614 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.131706 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.131925 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.132024 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.132232 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.132319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.132538 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.132624 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.132843 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.132932 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.133147 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.133239 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.133451 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.133538 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.133775 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.133928 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.134076 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.134222 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.134396 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.134541 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.134722 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.134859 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.135031 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.135175 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.135338 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.135484 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.135674 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.135811 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.135967 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.136111 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.136319 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.136432 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.136628 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.136714 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.136937 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.137024 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.137246 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.137340 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.137555 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.137648 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.137863 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.137949 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.138170 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.138256 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.138474 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.138559 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.138781 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.138876 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.139090 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.139175 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.139397 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.139562 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.140256 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.140364 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.140566 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.140655 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.140874 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.140962 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.141192 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.141293 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.141518 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.141609 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.141833 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.141929 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.142138 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.142226 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.142445 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.142532 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.142755 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.142965 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.143265 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.143353 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.143595 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.143686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.143926 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.144032 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.144247 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.144343 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.144567 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.144666 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.144878 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.144965 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.145189 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.145277 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.145498 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.145583 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.145798 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.145897 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.146101 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.146190 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.146407 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.146512 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.146714 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.146838 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.147019 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.147116 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.147333 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.147431 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.147660 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.147766 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.147962 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.148065 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.148276 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.148380 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.148581 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.148807 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.149102 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.149199 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.149439 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.149650 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.149748 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.149832 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.150055 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.150151 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.150376 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.150480 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.150689 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.150779 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.150992 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.151086 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.151308 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.151394 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.151632 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.151724 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.151934 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.152023 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.152245 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.152332 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.152546 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.152642 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.152848 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.152943 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.153147 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.153243 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.153451 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.153546 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.153754 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.153847 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.154051 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.154146 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.154353 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.154441 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.154652 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.154740 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.154971 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.155066 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.155289 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.155385 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.155644 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.155734 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.155953 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.156053 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.156257 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.156344 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.156555 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.156661 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.156859 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.156948 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.157161 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.157256 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.157461 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.157556 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.157765 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.157854 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.158061 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.158147 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.158364 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.158460 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.158664 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.158753 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.158970 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.159057 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.159311 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.159400 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.159633 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.159766 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.159935 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.160022 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.160252 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.160353 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.160553 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.160650 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.160852 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.160948 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.161161 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.161261 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.161467 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.161554 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.161782 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.161878 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.162086 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.162182 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.162391 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.162478 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.162729 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.162816 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.163041 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.163266 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.163587 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.163689 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.163921 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.164009 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.164239 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.164327 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.164567 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.164654 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.164895 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.164982 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.165200 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.165288 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.165506 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.165596 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.165810 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.165905 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.166131 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.166217 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.166437 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.166577 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.166747 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.166842 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.167058 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.167152 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.167364 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.167451 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.167702 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.167802 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.168015 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.168103 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.168326 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.168413 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.168637 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.168733 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.168949 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.169036 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.169260 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.169346 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.169562 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.169657 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.169870 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.169966 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.170176 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.170272 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.170745 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.170843 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.171588 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.171721 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.171927 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.172015 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.172241 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.172332 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.172555 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.172642 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.172869 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.172955 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.173182 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.173271 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.173492 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.173579 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.173805 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.173899 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.174110 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.174203 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.174416 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.174510 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.174727 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.174822 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.175052 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.175138 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.175361 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.175448 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.175689 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.176035 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.176324 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.176411 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.176639 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.176761 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.176961 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.177075 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.177280 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.177383 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.177586 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.177674 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.177906 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.177993 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.178220 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.178305 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.178526 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.178611 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.178842 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.178929 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.179150 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.179242 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.179474 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.179605 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.179880 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.179979 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.180148 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.180235 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.180462 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.180555 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.180763 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.180860 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.181066 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.181150 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.181366 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.181460 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.181673 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.181775 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.181985 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.182089 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.182288 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.182382 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.182588 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.182682 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.182888 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.182982 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.183193 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.183281 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.183513 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.183603 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.183812 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.183899 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.184114 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.184208 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.184414 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.184501 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.184717 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.184802 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.185017 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.185103 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.185318 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.185403 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.185618 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.185712 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.185919 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.186013 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.186219 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.186312 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.186539 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.186639 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.186873 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.186968 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.187182 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.187269 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.187480 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.187671 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.187802 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.187890 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.188101 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.188195 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.188401 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.188496 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.188729 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.188817 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.189058 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.189161 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.189395 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.189485 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.189684 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.189793 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.189994 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.190169 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.190332 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.190470 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.190615 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.190905 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.191038 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.191208 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.191342 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.191522 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.191616 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.191831 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.191919 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.192158 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.192256 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.192463 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.192552 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.192769 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.192867 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.193076 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.193173 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.193382 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.193472 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.193685 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.193782 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.193990 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.194077 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.194310 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.194399 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.194622 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.194717 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.194921 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.195008 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.195243 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.195330 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.195575 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.195669 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.195891 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.195980 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.196200 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.196294 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.196507 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.196596 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.196830 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.196924 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.197139 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.197248 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.197447 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.197548 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.197750 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.197838 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.198055 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.198152 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.198362 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.198449 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.198670 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.198756 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.198979 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.199074 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.199286 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.199375 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.199625 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.199714 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.199937 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.200035 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.200258 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.200349 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.200573 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.200660 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.200875 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.201010 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.201195 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.201291 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.201515 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.201602 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.201853 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.201941 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.202662 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.202758 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.203005 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.203093 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.203329 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.203417 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.203662 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.203752 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.203971 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.204058 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.204218 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 22:53:55.204307 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 22:53:55.204497 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 22:53:55.355546 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Registered counter for database nova_api Sep 09 22:53:55.358010 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO dbcounter [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Registered counter for database nova_api Sep 09 22:53:55.376373 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 22:53:55.379129 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 22:53:55.383043 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 22:53:55.386488 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writer thread running {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 22:53:55.440433 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.context [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a993bcac-a3a9-4583-94c3-ba20b13e6175(cell1) {{(pid=105420) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 22:53:55.444268 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.context [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a993bcac-a3a9-4583-94c3-ba20b13e6175(cell1) {{(pid=105419) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 22:53:55.444427 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 22:53:55.444758 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 22:53:55.446292 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 22:53:55.446989 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 22:53:55.447434 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 22:53:55.448383 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 22:53:55.448853 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 22:53:55.449393 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 22:53:55.450407 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 22:53:55.451118 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 22:53:55.451350 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Registered counter for database nova_cell0 Sep 09 22:53:55.451583 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 22:53:55.454109 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 22:53:55.456001 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Registered counter for database nova_cell1 Sep 09 22:53:55.456216 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO dbcounter [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Registered counter for database nova_cell0 Sep 09 22:53:55.460298 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO dbcounter [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Registered counter for database nova_cell1 Sep 09 22:53:55.463024 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 22:53:55.464660 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 22:53:55.467238 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 22:53:55.469840 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 22:53:55.470596 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 22:53:55.472801 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 22:53:55.473685 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writer thread running {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 22:53:55.610799 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writer thread running {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 22:53:55.614004 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Registered counter for database nova_cell0 Sep 09 22:53:55.620560 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO dbcounter [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Registered counter for database nova_cell0 Sep 09 22:53:55.623054 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 22:53:55.628154 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 22:53:55.629465 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 22:53:55.634079 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writer thread running {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 22:53:55.964633 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 22:53:55.970887 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: WARNING keystonemiddleware.auth_token [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 22:53:55.971828 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 22:53:55.978158 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: WARNING keystonemiddleware.auth_token [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 22:53:56.317626 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 22:53:56.323578 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 22:53:56.324096 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: WARNING keystonemiddleware.auth_token [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 22:53:56.328936 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae750a99c0 pid: 105420 (default app) Sep 09 22:53:56.330110 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: WARNING keystonemiddleware.auth_token [None req-9ef36646-bb05-45a3-b5ad-86ce4c1549d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 22:53:56.331508 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:53:56.332657 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Sep 09 22:53:56.333075 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Fri Sep 9 22:53:56 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:53:56.335443 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae750a99c0 pid: 105419 (default app) Sep 09 22:55:17.866823 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:17.868659 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002289 Sep 09 22:55:17.874957 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:17 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:17.889084 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:SELECT=3 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:17.892354 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_cell0:SELECT=3 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:17.893535 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_cell1:SELECT=3 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:17.894825 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:18.775704 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-d14d0ea2-9092-47bc-8a5f-90cbb59ea621 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:18.807360 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-d14d0ea2-9092-47bc-8a5f-90cbb59ea621 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930414 Sep 09 22:55:18.808169 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 9 22:55:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:55:21.433230 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:21.435467 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e8072a85-6537-42bb-954b-59e3db51d33a None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004543 Sep 09 22:55:21.436412 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:21 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:21.885248 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-6eb886c0-ad4e-42c3-8b2e-23d81e51289a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:21.932421 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-6eb886c0-ad4e-42c3-8b2e-23d81e51289a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489256 Sep 09 22:55:21.933222 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:55:21.947075 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:21.948010 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell1:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:21.950462 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell0:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:21.951168 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:22.156577 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-45e7e34d-cdca-48e3-96a2-dfabd8ce32eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:22.224996 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-45e7e34d-cdca-48e3-96a2-dfabd8ce32eb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283195 Sep 09 22:55:22.225589 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 22:55:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:55:24.832163 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-6eb886c0-ad4e-42c3-8b2e-23d81e51289a admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:24.833253 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-6eb886c0-ad4e-42c3-8b2e-23d81e51289a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001694 Sep 09 22:55:24.833925 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:25.477677 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-f67e8cf8-a8f4-4eb7-894a-dec96c27eca9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "id": "d1", "name": "ds512M", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:25.515822 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-f67e8cf8-a8f4-4eb7-894a-dec96c27eca9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.675700 Sep 09 22:55:25.516543 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:55:25.528903 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-16ef55ed-67fd-4bd0-a34d-b54a960824a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:25.567023 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-16ef55ed-67fd-4bd0-a34d-b54a960824a4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042259 Sep 09 22:55:25.567638 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 22:55:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 22:55:28.188897 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-f67e8cf8-a8f4-4eb7-894a-dec96c27eca9 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:28.190584 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-f67e8cf8-a8f4-4eb7-894a-dec96c27eca9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Sep 09 22:55:28.191091 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:28.597105 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0d14749f-fbbc-448b-8d75-180f90466578 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "swap": 0, "id": "d2", "name": "ds1G"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:28.616912 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-0d14749f-fbbc-448b-8d75-180f90466578 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418944 Sep 09 22:55:28.617546 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:55:28.629917 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-205ba2de-16a6-4f7d-b3d5-46855ee1791d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:28.662269 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-205ba2de-16a6-4f7d-b3d5-46855ee1791d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036224 Sep 09 22:55:28.662842 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 22:55:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:55:31.320081 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0d14749f-fbbc-448b-8d75-180f90466578 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:31.321010 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-0d14749f-fbbc-448b-8d75-180f90466578 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 09 22:55:31.321405 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:31.724393 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e687d4d1-66b3-4f10-9918-cae2f02b744d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "id": "d3", "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:31.750297 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e687d4d1-66b3-4f10-9918-cae2f02b744d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422338 Sep 09 22:55:31.751092 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:55:31.763807 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-340ac4d1-7ce9-47a7-94a1-198468b1b69b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:31.791194 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-340ac4d1-7ce9-47a7-94a1-198468b1b69b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031724 Sep 09 22:55:31.791980 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 22:55:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 22:55:34.481778 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e687d4d1-66b3-4f10-9918-cae2f02b744d admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:34.482793 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e687d4d1-66b3-4f10-9918-cae2f02b744d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 09 22:55:34.483193 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:34.910601 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-979c8564-c825-4437-a26f-1b51d862480c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:34.929850 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-979c8564-c825-4437-a26f-1b51d862480c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440549 Sep 09 22:55:34.930391 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 22:55:34.942331 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e7c7a958-36c2-4d6f-8d33-bb7561343406 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:34.966658 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e7c7a958-36c2-4d6f-8d33-bb7561343406 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027903 Sep 09 22:55:34.967226 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 22:55:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:55:37.618499 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-979c8564-c825-4437-a26f-1b51d862480c admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:37.619848 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-979c8564-c825-4437-a26f-1b51d862480c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001941 Sep 09 22:55:37.620450 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:38.056592 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-0c7c9b3c-d9a5-4905-af27-7bc93e555157 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:38.081034 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-0c7c9b3c-d9a5-4905-af27-7bc93e555157 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.453076 Sep 09 22:55:38.081637 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 9 22:55:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 22:55:40.626704 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-979c8564-c825-4437-a26f-1b51d862480c admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:40.627785 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-979c8564-c825-4437-a26f-1b51d862480c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 09 22:55:40.628188 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:41.038005 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-fbf9ce0b-3ce4-4014-872c-18d4eb8c21c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "vcpus": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:41.057109 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-fbf9ce0b-3ce4-4014-872c-18d4eb8c21c5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.422909 Sep 09 22:55:41.057739 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 22:55:41.069741 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-9ac154ee-eb6f-4e5a-8ad7-1264d2728b6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:41.097348 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-9ac154ee-eb6f-4e5a-8ad7-1264d2728b6b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031333 Sep 09 22:55:41.097907 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 22:55:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 22:55:43.685649 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-fbf9ce0b-3ce4-4014-872c-18d4eb8c21c5 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:43.686585 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-fbf9ce0b-3ce4-4014-872c-18d4eb8c21c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 09 22:55:43.686986 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:44.060168 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-50392de9-d41c-4842-b529-4599450723a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:44.080159 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-50392de9-d41c-4842-b529-4599450723a2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.387134 Sep 09 22:55:44.080725 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:55:44.093528 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-ff63120f-0d91-40ba-af24-8c6619331614 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:44.117390 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-ff63120f-0d91-40ba-af24-8c6619331614 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028064 Sep 09 22:55:44.117965 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 22:55:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:55:46.773636 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-50392de9-d41c-4842-b529-4599450723a2 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:46.774702 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-50392de9-d41c-4842-b529-4599450723a2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 09 22:55:46.775166 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:47.203907 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-88784b3d-9813-4892-a05d-07541b1d349c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:47.231404 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-88784b3d-9813-4892-a05d-07541b1d349c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449986 Sep 09 22:55:47.232188 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:55:47.244193 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-14a2c15d-15cc-4e7d-ae4e-16013b3a67e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:47.271119 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-14a2c15d-15cc-4e7d-ae4e-16013b3a67e8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030509 Sep 09 22:55:47.272040 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 22:55:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 22:55:49.930550 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-88784b3d-9813-4892-a05d-07541b1d349c admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:49.931481 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-88784b3d-9813-4892-a05d-07541b1d349c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 09 22:55:49.932136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:50.445751 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-9e604dca-6c9a-434a-9be6-88fe1b97f6fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:50.452990 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:50.468937 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-9e604dca-6c9a-434a-9be6-88fe1b97f6fd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.530475 Sep 09 22:55:50.469647 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:55:50.481728 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-67d0f3d5-b07c-4008-8b1c-8e7f86e9ce71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:50.505587 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-67d0f3d5-b07c-4008-8b1c-8e7f86e9ce71 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027458 Sep 09 22:55:50.506501 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 22:55:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:55:53.130439 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-9e604dca-6c9a-434a-9be6-88fe1b97f6fd admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:55:53.131451 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-9e604dca-6c9a-434a-9be6-88fe1b97f6fd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 09 22:55:53.131880 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:55:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:55:53.566007 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-61c4fe6d-d24b-42f9-823e-af54aac862e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:53.572791 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:55:53.588099 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-61c4fe6d-d24b-42f9-823e-af54aac862e9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449594 Sep 09 22:55:53.588682 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 22:55:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:55:53.601544 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-794960f8-f331-43d0-b522-481b823f58cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:55:53.633099 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-794960f8-f331-43d0-b522-481b823f58cb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036065 Sep 09 22:55:53.633688 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 22:55:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:56:11.236841 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-61c4fe6d-d24b-42f9-823e-af54aac862e9 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:11.238103 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-61c4fe6d-d24b-42f9-823e-af54aac862e9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Sep 09 22:56:11.238504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:56:11.249943 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:56:11.632130 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-8f52d73c-cc42-436a-bd4d-1ccf2a2edf26 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:11.650280 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-8f52d73c-cc42-436a-bd4d-1ccf2a2edf26 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405066 Sep 09 22:56:11.651399 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 9 22:56:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 22:56:12.999307 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-61c4fe6d-d24b-42f9-823e-af54aac862e9 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:13.000336 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-61c4fe6d-d24b-42f9-823e-af54aac862e9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 09 22:56:13.000734 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 22:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:56:13.518683 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-9f740667-eabb-4089-8289-856078494ad2 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:13.524453 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.wsgi [None req-9f740667-eabb-4089-8289-856078494ad2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-9f740667-eabb-4089-8289-856078494ad2 admin admin] Request method failure captured: Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Accept: application/json Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Accept-Encoding: gzip, deflate Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Connection: keep-alive Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Content-Length: 0 Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Host: 10.222.0.17 Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Openstack-Api-Version: compute 2.92 Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Openstack-System-Scope: None Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: User-Agent: python-novaclient Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Auth-Token: gAAAAABjG8SMYHd_ByEoWA_uUAjeCEdZ_UDWcyqsURM2cwGyLkLCRWj8R7nMMNzSmX5mhvxOr4I_wpgICDAqum7ptu3ScYflDtM9s_pBPAPUzaviA6s2wEF0IEhFMmPIWqJ-zwAftiXK8Zqq5kxAYSstiZY8sCWZCSJjXFHSvhzzD_wnJrQibjs Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Domain-Id: None Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Domain-Name: None Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Identity-Status: Confirmed Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Is-Admin-Project: True Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Domain-Id: default Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Domain-Name: Default Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Name: admin Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Role: reader,admin,member Sep 09 22:56:13.527963 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Roles: reader,admin,member Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8675cee43cc84599b492f8c81300cc82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant: admin Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant-Name: admin Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User: admin Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Domain-Id: default Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Domain-Name: Default Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Id: fa41a2a2137d4147a83f9f036ba03916 Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Name: admin Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: method: > Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: exception: Flavor 42 could not be found. Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: action_args: {'id': '42'} Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 22:56:13.529414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:13.530319 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.531513 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-9f740667-eabb-4089-8289-856078494ad2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 22:56:13.532905 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-9f740667-eabb-4089-8289-856078494ad2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392339 Sep 09 22:56:13.532905 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 9 22:56:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 22:56:13.539300 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-414078f5-77f4-4802-ab02-fcd0dfea209d admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:13.562296 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-414078f5-77f4-4802-ab02-fcd0dfea209d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026662 Sep 09 22:56:13.562816 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 22:56:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 22:56:13.573844 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-75631659-afb4-4661-9525-2f273c08c3a5 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:13.595120 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-75631659-afb4-4661-9525-2f273c08c3a5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026394 Sep 09 22:56:13.595688 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 22:56:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 22:56:13.605095 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e2c89015-9859-43fe-b089-f48e26c3527c admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:13.610164 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-e2c89015-9859-43fe-b089-f48e26c3527c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e2c89015-9859-43fe-b089-f48e26c3527c admin admin] Request method failure captured: Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Host: 10.222.0.17 Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjG8SMYHd_ByEoWA_uUAjeCEdZ_UDWcyqsURM2cwGyLkLCRWj8R7nMMNzSmX5mhvxOr4I_wpgICDAqum7ptu3ScYflDtM9s_pBPAPUzaviA6s2wEF0IEhFMmPIWqJ-zwAftiXK8Zqq5kxAYSstiZY8sCWZCSJjXFHSvhzzD_wnJrQibjs Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Role: reader,admin,member Sep 09 22:56:13.613378 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Roles: reader,admin,member Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8675cee43cc84599b492f8c81300cc82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User: admin Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Id: fa41a2a2137d4147a83f9f036ba03916 Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: method: > Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: exception: Flavor 42 could not be found. Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: action_args: {'id': '42'} Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 22:56:13.614702 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:13.615504 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:13.616540 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e2c89015-9859-43fe-b089-f48e26c3527c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 22:56:13.617545 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e2c89015-9859-43fe-b089-f48e26c3527c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013440 Sep 09 22:56:13.617545 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 9 22:56:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 22:56:14.850402 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-75631659-afb4-4661-9525-2f273c08c3a5 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:14.851514 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-75631659-afb4-4661-9525-2f273c08c3a5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 09 22:56:14.851921 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 22:56:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:56:15.370320 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-f4012a23-f6a5-4302-90ec-56c33e339aef admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:15.375235 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-f4012a23-f6a5-4302-90ec-56c33e339aef admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-f4012a23-f6a5-4302-90ec-56c33e339aef admin admin] Request method failure captured: Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Host: 10.222.0.17 Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjG8SOJffIm_XiMEFQxmAacd41hHH1n8IxgVALVa1rRzcVv9yvWZcEtGUnAyUp6OTfwrYUQFdjKX7tINVvfksJxRuB06U7c2Ca1bRqwU9Q3R71ushFkcYho7d1UULKCz6EekUQVQ1QYGW3LQGlhugK5jav6_lEAJ2PVy8aaoIKZaF-e_w Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Role: reader,admin,member Sep 09 22:56:15.376774 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Roles: reader,admin,member Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8675cee43cc84599b492f8c81300cc82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User: admin Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Id: fa41a2a2137d4147a83f9f036ba03916 Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: method: > Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: exception: Flavor 84 could not be found. Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: action_args: {'id': '84'} Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 22:56:15.378064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:15.378830 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.380136 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-f4012a23-f6a5-4302-90ec-56c33e339aef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 22:56:15.381525 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-f4012a23-f6a5-4302-90ec-56c33e339aef admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388277 Sep 09 22:56:15.381525 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 9 22:56:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 22:56:15.388467 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-ad859973-482f-46ed-9937-2afaeafe1622 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:15.403212 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-ad859973-482f-46ed-9937-2afaeafe1622 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018878 Sep 09 22:56:15.403774 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 22:56:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 22:56:15.413154 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-9e18873f-1107-4180-8546-87fe385b4bc9 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:15.428920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-9e18873f-1107-4180-8546-87fe385b4bc9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019270 Sep 09 22:56:15.429427 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 22:56:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 22:56:15.438788 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-d0ed32b6-7ae1-4aba-a026-8ce3e67298af admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:15.443728 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.wsgi [None req-d0ed32b6-7ae1-4aba-a026-8ce3e67298af admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-d0ed32b6-7ae1-4aba-a026-8ce3e67298af admin admin] Request method failure captured: Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Accept: application/json Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Accept-Encoding: gzip, deflate Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Connection: keep-alive Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Content-Length: 0 Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Host: 10.222.0.17 Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Openstack-Api-Version: compute 2.92 Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Openstack-System-Scope: None Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: User-Agent: python-novaclient Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Auth-Token: gAAAAABjG8SOJffIm_XiMEFQxmAacd41hHH1n8IxgVALVa1rRzcVv9yvWZcEtGUnAyUp6OTfwrYUQFdjKX7tINVvfksJxRuB06U7c2Ca1bRqwU9Q3R71ushFkcYho7d1UULKCz6EekUQVQ1QYGW3LQGlhugK5jav6_lEAJ2PVy8aaoIKZaF-e_w Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Domain-Id: None Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Domain-Name: None Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Identity-Status: Confirmed Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Is-Admin-Project: True Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Domain-Id: default Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Domain-Name: Default Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Name: admin Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Role: reader,admin,member Sep 09 22:56:15.445237 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Roles: reader,admin,member Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8675cee43cc84599b492f8c81300cc82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant: admin Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant-Name: admin Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User: admin Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Domain-Id: default Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Domain-Name: Default Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Id: fa41a2a2137d4147a83f9f036ba03916 Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Name: admin Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: method: > Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: exception: Flavor 84 could not be found. Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: action_args: {'id': '84'} Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 22:56:15.446773 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:15.447934 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:15.449172 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-d0ed32b6-7ae1-4aba-a026-8ce3e67298af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 22:56:15.450193 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-d0ed32b6-7ae1-4aba-a026-8ce3e67298af admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011183 Sep 09 22:56:15.450193 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 9 22:56:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 22:56:16.662331 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-9e18873f-1107-4180-8546-87fe385b4bc9 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:16.663339 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-9e18873f-1107-4180-8546-87fe385b4bc9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 09 22:56:16.663763 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 22:56:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 22:56:17.182042 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0fbd4f14-2e6d-4d93-ad45-c5206cbd4f15 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:17.187835 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.wsgi [None req-0fbd4f14-2e6d-4d93-ad45-c5206cbd4f15 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0fbd4f14-2e6d-4d93-ad45-c5206cbd4f15 admin admin] Request method failure captured: Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Accept: application/json Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Accept-Encoding: gzip, deflate Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Connection: keep-alive Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Content-Length: 0 Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Host: 10.222.0.17 Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Openstack-Api-Version: compute 2.92 Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Openstack-System-Scope: None Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: User-Agent: python-novaclient Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Auth-Token: gAAAAABjG8SQ6LGqWric3rrCdTILVLvZZwg6JC71sY7FUNzkoN74oAG5kva35wBmH37AlPRT7hvORHwLjEHLn9EA6K-eFAJDKI_vx_M3_gPfyEzwd6WoiVcj0oR7VIPfb0MoXhJUx-qo3d_HAXZdXEcRAgAOdTbIi7c9HepYPFPmlonUuWRLo1M Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Domain-Id: None Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Domain-Name: None Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Identity-Status: Confirmed Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Is-Admin-Project: True Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Domain-Id: default Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Domain-Name: Default Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Project-Name: admin Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Role: reader,admin,member Sep 09 22:56:17.189335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Roles: reader,admin,member Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8675cee43cc84599b492f8c81300cc82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant: admin Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-Tenant-Name: admin Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User: admin Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Domain-Id: default Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Domain-Name: Default Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Id: fa41a2a2137d4147a83f9f036ba03916 Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: X-User-Name: admin Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: method: > Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: exception: Flavor 451 could not be found. Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: action_args: {'id': '451'} Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 22:56:17.190750 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:17.192686 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.193933 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0fbd4f14-2e6d-4d93-ad45-c5206cbd4f15 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 22:56:17.195006 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-0fbd4f14-2e6d-4d93-ad45-c5206cbd4f15 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390626 Sep 09 22:56:17.195006 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 22:56:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 22:56:17.200398 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-9bebec85-40e3-49a5-bfe9-1fb043e85ae2 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:17.215645 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-9bebec85-40e3-49a5-bfe9-1fb043e85ae2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018726 Sep 09 22:56:17.216167 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 22:56:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 22:56:17.225234 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:17.240417 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018674 Sep 09 22:56:17.240939 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 22:56:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 22:56:17.250058 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-18348796-a9da-49a7-8fa0-8577ec767aae admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:17.254894 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-18348796-a9da-49a7-8fa0-8577ec767aae admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-18348796-a9da-49a7-8fa0-8577ec767aae admin admin] Request method failure captured: Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Host: 10.222.0.17 Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjG8SQ6LGqWric3rrCdTILVLvZZwg6JC71sY7FUNzkoN74oAG5kva35wBmH37AlPRT7hvORHwLjEHLn9EA6K-eFAJDKI_vx_M3_gPfyEzwd6WoiVcj0oR7VIPfb0MoXhJUx-qo3d_HAXZdXEcRAgAOdTbIi7c9HepYPFPmlonUuWRLo1M Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Role: reader,admin,member Sep 09 22:56:17.256415 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Roles: reader,admin,member Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8675cee43cc84599b492f8c81300cc82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8675cee43cc84599b492f8c81300cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 8675cee43cc84599b492f8c81300cc82 Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User: admin Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Id: fa41a2a2137d4147a83f9f036ba03916 Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: method: > Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: exception: Flavor 451 could not be found. Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: action_args: {'id': '451'} Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 22:56:17.257920 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:17.258787 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 22:56:17.259887 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-18348796-a9da-49a7-8fa0-8577ec767aae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 22:56:17.260884 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-18348796-a9da-49a7-8fa0-8577ec767aae admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011235 Sep 09 22:56:17.260884 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 22:56:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 22:56:18.456667 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:18.457701 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 09 22:56:18.458094 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 22:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:56:18.985972 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-1627f3f3-4e09-4b0d-87ed-b3dc57873d5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:56:19.006331 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-1627f3f3-4e09-4b0d-87ed-b3dc57873d5b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405502 Sep 09 22:56:19.006874 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 9 22:56:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:56:20.220995 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:20.222006 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 09 22:56:20.222399 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 22:56:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:56:20.753229 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-1b692e43-342e-42a3-83cb-f731e98f9153 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:56:20.771237 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-1b692e43-342e-42a3-83cb-f731e98f9153 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.409296 Sep 09 22:56:20.771813 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 9 22:56:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:56:21.980364 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:21.981369 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 09 22:56:21.981761 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 22:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:56:22.538403 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-4aef537b-4f5a-437c-8fcc-f1385fa38f4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:56:22.558953 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-4aef537b-4f5a-437c-8fcc-f1385fa38f4c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.440575 Sep 09 22:56:22.559419 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 9 22:56:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 22:56:23.772477 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:23.773421 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 09 22:56:23.773807 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 22:56:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:56:24.291771 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-725b2a55-5d56-45ae-85cd-5828477e2a84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 22:56:24.310856 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-725b2a55-5d56-45ae-85cd-5828477e2a84 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399377 Sep 09 22:56:24.311398 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 9 22:56:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 22:56:25.519449 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:25.520520 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 09 22:56:25.520912 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 22:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:56:26.037507 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-2a91df3a-fc2f-41d2-8c74-356cb11dfcd9 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:56:26.058563 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-2a91df3a-fc2f-41d2-8c74-356cb11dfcd9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400727 Sep 09 22:56:26.059085 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Fri Sep 9 22:56:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 22:57:22.720394 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:57:22.721328 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-105a8d26-ddbc-4cac-93d2-81e201f1e2a7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 09 22:57:22.721723 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 22:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 22:57:22.732945 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:57:23.106743 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-21b6f43a-d787-43cf-85ca-d3e61fa12230 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:57:23.126611 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-21b6f43a-d787-43cf-85ca-d3e61fa12230 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398153 Sep 09 22:57:23.127147 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 9 22:57:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 22:57:23.149365 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:SELECT=14 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 22:57:23.153464 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-c1640523-5594-479d-bfe8-39180a5e3dd8 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:57:23.160771 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-c1640523-5594-479d-bfe8-39180a5e3dd8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013375 Sep 09 22:57:23.161284 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Fri Sep 9 22:57:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:57:23.173098 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-6076d68a-ef4b-4aeb-83bb-c82382a3b0d1 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:57:23.180816 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-6076d68a-ef4b-4aeb-83bb-c82382a3b0d1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011532 Sep 09 22:57:23.181317 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Fri Sep 9 22:57:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:57:23.192317 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:57:23.200081 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011267 Sep 09 22:57:23.200598 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Fri Sep 9 22:57:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 22:57:23.211453 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-58214966-9f8e-45f1-a056-d64ce4713dc5 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 22:57:23.218431 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-58214966-9f8e-45f1-a056-d64ce4713dc5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010312 Sep 09 22:57:23.218930 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Fri Sep 9 22:57:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:00:25.245211 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:00:25.246255 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 09 23:00:25.246647 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 23:00:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:00:25.388547 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=6 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:00:25.545463 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-9f0d2167-3c73-4732-a103-7e608d386a74 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:00:25.550420 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9f0d2167-3c73-4732-a103-7e608d386a74 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:00:25.550894 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9f0d2167-3c73-4732-a103-7e608d386a74 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:00:25.551842 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9f0d2167-3c73-4732-a103-7e608d386a74 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:00:25.552550 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9f0d2167-3c73-4732-a103-7e608d386a74 admin admin] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:00:25.552995 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9f0d2167-3c73-4732-a103-7e608d386a74 admin admin] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:00:25.553408 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9f0d2167-3c73-4732-a103-7e608d386a74 admin admin] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:00:25.584482 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-9f0d2167-3c73-4732-a103-7e608d386a74 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.197244 Sep 09 23:00:25.585028 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 23:00:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:00:26.667335 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:00:26.668400 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 09 23:00:26.668794 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 23:00:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:00:26.858064 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-44faf24f-81a5-4099-8490-b79e17f3b5e7 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:00:26.861512 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-44faf24f-81a5-4099-8490-b79e17f3b5e7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:00:26.861982 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-44faf24f-81a5-4099-8490-b79e17f3b5e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:00:26.862406 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-44faf24f-81a5-4099-8490-b79e17f3b5e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:00:26.863115 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-44faf24f-81a5-4099-8490-b79e17f3b5e7 admin admin] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:00:26.863584 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-44faf24f-81a5-4099-8490-b79e17f3b5e7 admin admin] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:00:26.864028 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-44faf24f-81a5-4099-8490-b79e17f3b5e7 admin admin] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:00:26.882888 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-44faf24f-81a5-4099-8490-b79e17f3b5e7 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.075853 Sep 09 23:00:26.883424 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 23:00:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:00:38.365431 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:00:38.366470 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001944 Sep 09 23:00:38.366867 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 23:00:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:00:38.511895 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell0:SELECT=4 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:00:38.512604 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell1:SELECT=4 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:00:38.513288 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=8 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:00:38.565204 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-9bc0a671-6a3d-4754-8347-838e92bdd8f2 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:00:38.568904 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9bc0a671-6a3d-4754-8347-838e92bdd8f2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:00:38.569390 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9bc0a671-6a3d-4754-8347-838e92bdd8f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:00:38.569875 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9bc0a671-6a3d-4754-8347-838e92bdd8f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:00:38.570598 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9bc0a671-6a3d-4754-8347-838e92bdd8f2 admin admin] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:00:38.571048 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9bc0a671-6a3d-4754-8347-838e92bdd8f2 admin admin] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:00:38.571468 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-9bc0a671-6a3d-4754-8347-838e92bdd8f2 admin admin] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:00:38.597570 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-9bc0a671-6a3d-4754-8347-838e92bdd8f2 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.089879 Sep 09 23:00:38.598235 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 23:00:38 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:00:39.685414 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:00:39.686420 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-efde1454-5abd-4fe0-ab15-e6834051d41a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 09 23:00:39.686832 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 23:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:00:39.874079 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-2f0cf550-588f-4fa6-bc86-da86a45093cd admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:00:39.877514 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-2f0cf550-588f-4fa6-bc86-da86a45093cd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:00:39.877987 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-2f0cf550-588f-4fa6-bc86-da86a45093cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:00:39.878413 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-2f0cf550-588f-4fa6-bc86-da86a45093cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:00:39.879122 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-2f0cf550-588f-4fa6-bc86-da86a45093cd admin admin] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:00:39.879591 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-2f0cf550-588f-4fa6-bc86-da86a45093cd admin admin] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:00:39.880005 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-2f0cf550-588f-4fa6-bc86-da86a45093cd admin admin] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:00:39.901914 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-2f0cf550-588f-4fa6-bc86-da86a45093cd admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.077415 Sep 09 23:00:39.902412 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 23:00:39 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:01:36.369990 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: Fri Sep 9 23:01:36 2022 - graceful shutdown triggered... Sep 09 23:01:36.370484 dv-cinder-852211-14-iscsi devstack@n-api.service[105420]: Gracefully killing worker 2 (pid: 105420)... Sep 09 23:01:36.370106 dv-cinder-852211-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 23:01:36.371299 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: Gracefully killing worker 1 (pid: 105419)... Sep 09 23:01:36.496620 dv-cinder-852211-14-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:SELECT=4 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:01:37.371141 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: worker 1 buried after 1 seconds Sep 09 23:01:37.371727 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: worker 2 buried after 1 seconds Sep 09 23:01:37.371727 dv-cinder-852211-14-iscsi devstack@n-api.service[105418]: goodbye to uWSGI. Sep 09 23:01:37.372782 dv-cinder-852211-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 23:01:37.373332 dv-cinder-852211-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 23:01:37.376112 dv-cinder-852211-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 23:01:37.386887 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 23:01:37.389641 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 23:01:37 2022] *** Sep 09 23:01:37.389812 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 23:01:37.389946 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 23:01:37.390068 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: nodename: dv-cinder-852211-14-iscsi Sep 09 23:01:37.390186 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: machine: x86_64 Sep 09 23:01:37.390297 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: clock source: unix Sep 09 23:01:37.390405 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: pcre jit disabled Sep 09 23:01:37.390514 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: detected number of CPU cores: 4 Sep 09 23:01:37.390623 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: current working directory: / Sep 09 23:01:37.390739 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: detected binary path: /usr/bin/uwsgi-core Sep 09 23:01:37.390880 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: your processes number limit is 47680 Sep 09 23:01:37.390880 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: your memory page size is 4096 bytes Sep 09 23:01:37.390880 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: detected max file descriptor number: 2048 Sep 09 23:01:37.390880 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: lock engine: pthread robust mutexes Sep 09 23:01:37.391194 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: thunder lock: enabled Sep 09 23:01:37.391264 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 23:01:37.391333 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 23:01:37.431745 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: Python main interpreter initialized at 0x561ea708f9c0 Sep 09 23:01:37.431745 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: python threads support enabled Sep 09 23:01:37.431745 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: your server socket listen backlog is limited to 100 connections Sep 09 23:01:37.431745 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: your mercy for graceful operations on workers is 90 seconds Sep 09 23:01:37.432114 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 23:01:37.432188 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: *** Operational MODE: preforking *** Sep 09 23:01:37.432429 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: *** uWSGI is running in multiple interpreter mode *** Sep 09 23:01:37.432429 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: spawned uWSGI master process (pid: 120579) Sep 09 23:01:37.432631 dv-cinder-852211-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 23:01:37.434306 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: spawned uWSGI worker 1 (pid: 120598, cores: 1) Sep 09 23:01:37.436369 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: spawned uWSGI worker 2 (pid: 120603, cores: 1) Sep 09 23:01:37.436687 dv-cinder-852211-14-iscsi devstack@n-api.service[120579]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 23:01:38.103791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 23:01:38.104444 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 23:01:39.268522 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:01:39.268522 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: from cryptography.utils import int_from_bytes Sep 09 23:01:39.269123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:01:39.269123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: from cryptography.utils import int_from_bytes Sep 09 23:01:39.292379 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:01:39.292379 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: from cryptography.utils import int_from_bytes Sep 09 23:01:39.292930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:01:39.292930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: from cryptography.utils import int_from_bytes Sep 09 23:01:41.659367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 23:01:41.659992 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 23:01:41.660303 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 23:01:41.660496 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 23:01:41.660748 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 23:01:41.661150 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.661478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.661810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.662173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.662509 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.662827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.663152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.663479 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.663840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.664105 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.664424 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.664930 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-14-iscsi {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.665268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.665588 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.665910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.666242 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.666554 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.666883 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.667194 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.667740 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.669176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.669176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.669176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.669454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.669783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.670101 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.670431 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.670750 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.671083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.671406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.671857 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-14-iscsi {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.672190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.672518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.672827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.673254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.673570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.673885 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.674212 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.674792 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.675124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.675458 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.675807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.676132 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.676458 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.676767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.677080 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.677396 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.677767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.678079 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.678397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.678649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.678964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.679292 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.679647 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.679980 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.680240 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.680495 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.680817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.681145 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.681459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.681779 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.682538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.682538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.682747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.682973 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.683284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.683631 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.683959 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.684279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.684606 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.684917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.685239 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.685702 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.685958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.686271 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.686619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.686938 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.687250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.687601 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.687932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.688243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.688559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.688865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.689190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.689514 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.689820 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.690088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.690380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.690686 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.691007 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.691315 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.694864 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.695264 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.695623 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.695970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.696307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.696643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.696970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.697293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.697617 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.697939 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.698259 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.698598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.698902 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.699245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.699683 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.700012 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.700331 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.700649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.701013 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.701349 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.701668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.701981 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.702313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.702630 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.702944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.703273 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.703615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.703932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.704262 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.704769 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.705088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.705414 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.705727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.706045 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.706353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.706661 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.706981 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.707290 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.707625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.707940 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.708245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.708572 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.709476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.709804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.710120 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.710432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.710764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.711117 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.714828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.714828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.714828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.714828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.714828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.714828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.714828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.714828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.715469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.715469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.715469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.715469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.715469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.715831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.716218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.716473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.716779 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.717107 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.717428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.717755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.718091 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.718428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.718747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.719098 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.719453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.719818 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.720155 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.720489 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.720809 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.721129 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.721449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.721813 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.722133 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.722452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.722777 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.723098 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.723428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.723870 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.724201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.724551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.724888 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.725211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.725553 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.725874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.726204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.726525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.730192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.730192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.730192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.730192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.730514 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 23:01:41.730914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.730989 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 23:01:41.731065 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.731065 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.731222 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 23:01:41.731299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.731375 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 23:01:41.731451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.731805 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 23:01:41.731908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.731981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.732050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.732126 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.732196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.732272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.732348 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.732424 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.732500 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.732581 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.732658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.732762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.732865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.732938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.733007 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.733106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.733180 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.733258 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.733335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.733421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.733517 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.733591 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.733668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.733739 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-14-iscsi {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.733814 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.733897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.733979 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.734049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.734126 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.734202 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.734279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.734350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.734508 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.734650 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.734950 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.735257 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.735421 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.735789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.736104 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.736232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.736408 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.736722 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.736990 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.737118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.737365 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.737676 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.738994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.738994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.738994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.738994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.739319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-14-iscsi {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.739455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.739648 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.739868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.740176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.740278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.740496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.740621 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.740912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.741010 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.741246 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.741351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.741579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.741685 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.741902 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.742000 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.742226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.742322 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.742575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.742672 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.742913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.743063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.743213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.743361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.743562 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.743724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.743878 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.744028 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.744171 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.744319 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.744473 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.744646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.744790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.744932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.745092 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.745263 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.745435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.745585 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.745729 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.745892 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.746044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.746195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.746394 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.746549 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.746699 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.746935 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.747298 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.747459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.747636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.747785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.747936 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.748090 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.748675 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.748936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.749096 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.749240 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.749383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.749532 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.749689 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.749842 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.749997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.750139 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.750288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.750447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.750597 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.750597 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.750882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.751031 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.751180 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.751330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.751479 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.751672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.751824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.751968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.752110 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.752257 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.752407 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.752578 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.752815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.752973 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.753119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.753270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.753407 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.753555 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.753700 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.753847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.753933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.754070 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.754209 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.754398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.754533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.754668 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.754804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.754944 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.755094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.755242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.755391 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.755543 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.756163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.756250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.756396 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.756491 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.756582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.756673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.756762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.756852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.756947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.757036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.757138 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.757406 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.757501 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.757593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.757684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.757767 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.757855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.757948 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.758068 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.758174 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.758384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.758505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.758690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.758804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.758995 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.759119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.759294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.759406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.759624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.759727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.759931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.760049 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.760235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.760348 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.760538 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.760641 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.760841 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.760953 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.761145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.761247 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.761447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.761557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.761747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.761874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.762049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.762218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.762350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.762535 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.762666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.762850 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.762984 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.763177 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.763520 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.763628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.763834 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.763928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.764151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.764319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.764466 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.764561 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.764778 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.764872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.765086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.765193 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.765391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.765495 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.765704 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.765796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.766005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.766105 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.766308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.766401 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.766625 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.766719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.766931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.767035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.767233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.767342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.767624 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.767733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.767871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.767966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.768175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.768279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.768490 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.768587 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.768796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.768890 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.769103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.769278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.769428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.769580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.769737 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.769889 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.770030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.770169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.770315 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.770468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.770615 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.770755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.770900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.771038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.771176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.771870 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.772021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.772113 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.772347 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.772437 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.772658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.772764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.772962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.773053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.773265 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.773356 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.773583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:01:41.773682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.773920 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.774018 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.774243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.774343 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.774565 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.774663 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.774893 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.774991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.775213 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.775303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.775550 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.775870 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.776191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.776331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.776503 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.776657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.776819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.776976 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.777149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.777295 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.777578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.777684 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.777759 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.777933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.778078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.778246 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.778387 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.778602 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.778820 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.778912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.778996 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.780435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.780537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.780629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.780726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.780816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.780906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.780996 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781086 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781264 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781347 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781456 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781634 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781842 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.781942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.782159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.782249 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.782469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.782584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.782782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.782931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.783091 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.783248 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.783397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.783600 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.783928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.784242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.784562 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.784755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.784907 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.785066 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.785220 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.785386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.785534 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.785677 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.785817 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.785957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.786097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.786246 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.786396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.786540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.786710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.786885 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.787067 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.787220 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.787372 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.787544 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.787775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.787896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.788096 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.788271 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.788410 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.788593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.788838 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.788945 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.789043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.789300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.789464 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.789616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.789754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.789899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.790054 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.790194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.790390 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.790533 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.790708 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.790844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.791055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.791200 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.791366 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.791562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.791701 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.791805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.792007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.792100 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.792312 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.792410 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.792624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.792723 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.792929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.793029 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.793251 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.793349 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.793557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.793710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.793872 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.793964 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.794187 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.794286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.794496 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.794595 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.794807 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.794898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.795119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.795204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.795429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.795562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.795763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.795854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.796078 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.796175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.796390 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.796480 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.796692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.796789 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.797009 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.797099 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.797318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.797407 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.797624 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.797726 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.797935 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.798048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.798238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.798329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.798545 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.798635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.798903 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.799008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.799159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.799572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.799791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.799897 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.800068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.800170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.800381 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.800473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.800707 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.800797 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.801020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.801120 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.801333 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.801423 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.801652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.801743 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.801960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.802063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.802275 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.802372 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.803104 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.803208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.803416 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.803540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.803766 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.803863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.804072 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.804162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.804377 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.804474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.804679 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.804775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.804984 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.805075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.805288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.805380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.805596 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.805686 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.806020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.806125 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.806236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.806328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.806490 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.806595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.806792 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.806904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.807093 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.807191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.807404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.807523 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.807741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.807847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.808086 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.808192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.808356 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.808446 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.808657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.808760 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.809061 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.809200 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.809299 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.809395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.809595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.809765 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.809993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.810167 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.810622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.810871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.811127 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.811301 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.811447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.811618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.811776 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.811872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.811974 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812168 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812261 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812439 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812532 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812624 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812809 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.812910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.813119 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.813219 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.813434 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.813535 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.813745 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.813845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.814061 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.814164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.814370 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.814463 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.814690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.814783 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.814992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.815097 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.815768 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.815858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.815943 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816300 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816689 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816879 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.816989 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.817192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.817284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.817511 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.817606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.817809 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.817912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.818209 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.818852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.818982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.819077 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.819304 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.819424 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.819636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.819732 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.819985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.820109 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.820262 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.820357 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.820584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.820674 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.820894 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.820994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.821208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.821308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.821508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.821598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.821822 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.821913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.822137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.822228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.822448 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.822543 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.822764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.822868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.823074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.823165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.823382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.823479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.823763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.823874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.824032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.824124 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.824342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.824438 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.824648 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.824747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.824954 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.825087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.825265 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.825405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.825579 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.825720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.825889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.826030 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.826204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.826366 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.826587 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.826734 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.826887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.827036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.827185 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.827333 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.827483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.827600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.827711 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.828002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.828098 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.828320 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.828439 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.828629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.828722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.828942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.829044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.829300 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.829417 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.829549 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.829643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.829851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.829954 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.830175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.830295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.830483 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.830654 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.830801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.830942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.831104 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.831251 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.831389 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.831556 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.831727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.831819 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.832041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.832140 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.832344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.832464 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.832662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.832782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.832983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.833075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.833294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.833498 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.833598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.833843 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.833938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.834160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.834259 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.834487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.834585 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.834818 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.834911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.835133 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.835224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.835444 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.835559 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.835780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.835879 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.836092 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.836184 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.836405 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.836505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.836730 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.836831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.837042 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.837140 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.837354 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.837454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.837662 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.837752 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.837963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.838053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.838277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.838456 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.838611 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.838753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.838922 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.839153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.839412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.839614 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.839720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.839830 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.839997 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.840155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.840327 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.840496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.840643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.840799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.840948 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.841128 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.841269 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.841459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.841595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.841775 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.841919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.842069 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.842210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.842382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.842525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.842689 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.842834 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.842987 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.843128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.843285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.843432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.843605 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.843707 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.843901 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.844000 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.844206 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.844305 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.844518 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.844616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.844824 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.844921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.845127 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.845218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.845429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.845527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.845733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.845824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.846047 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.846144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.846351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.846448 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.846662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.846753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.846966 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.847110 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.847290 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.847381 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.847628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.847735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.847935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.848041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.848240 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.848331 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.848552 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.848656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.848883 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.848989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.849188 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.849278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.849554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.849667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.849868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.849967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.850207 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.850314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.850512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.850610 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.850818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.850908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.851143 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.851229 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.851450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.851579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.851776 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.851876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.852082 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.852173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.852393 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.852485 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.852703 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.852800 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.853004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.853098 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.853313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.853403 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.853622 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.853721 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.853929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.854019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.854232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.854331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.854533 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.854631 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.854838 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.854929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.855138 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.855241 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.855450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.855563 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.855782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.855874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.856085 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.856189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.856387 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.856477 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.856693 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.856799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.856999 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.857121 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.857301 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.857391 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.857616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.857714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.857919 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.858010 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.858233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.858324 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.858536 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.858648 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.858842 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.858946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.859142 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.859241 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.859452 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.859582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.859839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.859942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.860145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.860235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.860462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.860549 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.860771 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.860867 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.861076 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.861167 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.861379 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.861546 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.861688 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.861780 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.861991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.862090 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.862294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.862527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.862632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.862863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.862955 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.863183 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.863275 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.863515 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.863610 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.863827 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.863926 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.864149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.864372 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.864463 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.864692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.864783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.865512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.865625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.865829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.865921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.866137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.866228 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.866444 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.866545 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.866749 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.866847 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.867054 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.867144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.867357 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.867449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.867703 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.867817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.868019 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.868121 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.868323 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.868445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.868628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.868767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.868975 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.869131 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.869262 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.869449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.869569 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.869761 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.869925 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.870081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.870232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.870399 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.870548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.870724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.870851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.871042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.871165 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.871357 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.871473 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.871703 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.871810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.872021 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.872116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.872335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.872430 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.872649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.872753 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.872966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.873062 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.873279 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.873373 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.873581 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.873690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.873901 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.873997 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.874213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.874314 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.874524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.874633 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.874845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.874947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.875166 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.875267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.875517 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.875720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.875823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.876044 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.876137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.876385 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.876492 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.876703 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.876818 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.877015 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.877109 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.877325 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.877440 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.877639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.877741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.877956 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.878051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.878265 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.878372 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.878575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.878666 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.878887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.879076 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.879228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.879380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.879535 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.879625 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.879816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.879906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.880124 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.880232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.880442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.880539 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.881309 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.881411 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.881619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.881725 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.881935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.882160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.882261 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.882521 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.882622 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.882833 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.882931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.883167 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.883264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.883535 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.883631 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.883845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.883945 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.884160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.884259 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.884482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.884581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.884792 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.884881 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.885107 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.885198 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.885423 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.885522 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.885728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.885820 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.886034 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.886146 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.886344 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.886460 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.886660 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.886758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.886977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.887087 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.887283 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.887382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.887627 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.887735 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.887940 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.888046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.888272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.888363 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.888581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.888672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.888883 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.888980 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.889201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.889324 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.889498 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.889595 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.889802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.889906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.890111 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.890208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.890420 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.890518 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.890728 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.890828 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.891047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.891148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.891356 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.891529 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.891788 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.891876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.892096 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.892197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.892413 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.892514 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.892759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.892840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.893076 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.893177 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.893377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.893468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.893689 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.893782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.893998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.894088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.894301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.894391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.894623 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.894711 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.894931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.895011 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.895244 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.895341 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.895568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.895667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.895897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.895986 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.896239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.896336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.896559 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.896665 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.897367 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.897478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.897553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.897632 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.897720 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.897793 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.897905 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.898062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.898252 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.898403 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.898554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.898717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.898860 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.899025 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.899172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.899337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.899507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.899694 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.899798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.900070 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.900192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.900331 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.900419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.900627 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.900730 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.900941 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.901090 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.901254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.901354 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.901568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.901666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.901881 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.902016 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.902186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.902285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.902497 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.902596 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.902798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.902891 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.903110 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.903207 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.903422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.903549 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.903764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.903857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.904081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.904171 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.904383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.904473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.904703 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.904803 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.905014 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.905116 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.905319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.905419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.905624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.905722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.905925 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.906016 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.906263 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.906366 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.906566 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.906656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.906874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.906972 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.907185 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.907285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.907545 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.907661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.907845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.907937 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.908161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.908260 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.908473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.908564 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.908800 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.908891 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.909111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.909200 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.909487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.909591 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.909747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.909847 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.910051 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.910157 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.910357 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.910468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.910666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.910764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.910970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.911070 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.911275 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.911370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.911603 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.911710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.911941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.912043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.912246 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.912373 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.912548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.912688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.912849 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.913019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.913170 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.913329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.913471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.913639 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.913792 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.913932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.914099 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.914248 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.914386 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.914568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.914692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.914880 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.914997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.915193 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.915341 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.915527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.915672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.915835 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.916001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.916144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.916314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.916452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.916639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.916758 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.916957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.917048 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.917271 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.917363 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.917604 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.917740 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.917909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.918029 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.918224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.918337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.918534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.918640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.918841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.918960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.919147 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.919251 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.919457 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.919589 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.919794 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.919917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.920109 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.920205 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.920450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.920618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.920777 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.920942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.921094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.921280 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.922044 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.922214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.922372 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.922530 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.922679 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.922828 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.922982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.923155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.923312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.923461 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.923730 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.923884 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.924041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.924200 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.924599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.924747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.924902 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.925059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.925223 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.925575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.925727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.925876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.926211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.926410 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.926497 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.926589 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.926673 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.926764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.926854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.926945 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.927030 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.927118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.927210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.927294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.927386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928215 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928398 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928484 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928575 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.928973 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.929065 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.929299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.929397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.929635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.929739 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.929937 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.930036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.930272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.930363 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.930591 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.930710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.930903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.930994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.931216 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.931309 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.931553 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.931661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.931870 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.931971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.932190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.932281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.932501 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.932593 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.932813 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.932913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.933124 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.933223 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.933442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.933653 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.933773 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.933973 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.934104 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.934308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.934412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.934635 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.934734 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.934963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.935062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.935282 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.935380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.935624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.935729 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.935957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.936049 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.936266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.936381 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.936574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.936701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.936887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.937017 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.937201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.937328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.937507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.937600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 23:01:41.937832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.938145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.938455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.938775 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.939083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.939636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.939988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.940303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.940684 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.940954 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.941270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.941578 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.941900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.942204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.942511 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.942878 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.943184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.944001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.944307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.944618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.944932 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.945236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.945548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.945853 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.946181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.946485 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.946790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.947093 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.947404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.947732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.948040 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.948352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.948655 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.948966 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.949270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.949672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.949978 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.950289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.950645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.950957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.951258 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.951672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.951984 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.952289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.952606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.952931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.953242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.953555 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.953867 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.954213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.954531 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.955065 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.955400 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.955746 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.956084 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.956418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.956727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.957034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.957339 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.957662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.957971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.958297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.958596 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.958931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.959240 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.959572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.959882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.960187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.960495 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.960804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.961115 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.961419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.961728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.962039 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.962350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.962690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.963011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.963331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.963673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.963993 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.964304 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.964612 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.964942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.965505 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.965828 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.966160 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.966475 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.966782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.967208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.967544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.967870 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.968197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.968511 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.968833 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.969155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.969469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.969789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.970102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.970433 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.970770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.971101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.971426 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.971759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.972067 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.972372 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.972681 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.972996 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.973302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.973607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.973906 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.974214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.974543 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.974847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.975148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.975449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.975780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.976081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.976383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.976683 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.976983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.977285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.977586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.977893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.978196 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.978516 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.978801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.979102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.979402 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.979754 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.980085 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.980402 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.980721 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.981030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.981350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.981660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.981990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.982300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.982620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.982928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.983263 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.983631 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.983909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.984222 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.984533 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.984845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.985154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.985481 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.985806 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.986112 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.986435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.986750 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.987077 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.987391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.987724 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.988056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.988372 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.988681 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.988990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.989300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.989607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.989921 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.990747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.991054 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.991370 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.991708 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.992036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.992360 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.992670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.992994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.993352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.993780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.994006 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.994347 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.994671 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.994985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.995320 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.995621 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:01:41.995865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 23:01:41.999648 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO dbcounter [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Registered counter for database nova_api Sep 09 23:01:42.020187 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:01:42.026751 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:01:42.058981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Registered counter for database nova_api Sep 09 23:01:42.080205 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:01:42.084706 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.context [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a993bcac-a3a9-4583-94c3-ba20b13e6175(cell1) {{(pid=120598) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 23:01:42.087032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:01:42.088785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:01:42.089277 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:01:42.090856 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:01:42.091636 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:01:42.092087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:01:42.094078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:01:42.096116 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO dbcounter [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Registered counter for database nova_cell0 Sep 09 23:01:42.100244 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO dbcounter [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Registered counter for database nova_cell1 Sep 09 23:01:42.108599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:01:42.109581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:01:42.117612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:01:42.119230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:01:42.144632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.context [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a993bcac-a3a9-4583-94c3-ba20b13e6175(cell1) {{(pid=120603) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 23:01:42.149006 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:01:42.149667 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:01:42.151234 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:01:42.151993 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:01:42.152439 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:01:42.154418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:01:42.156436 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Registered counter for database nova_cell0 Sep 09 23:01:42.160507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Registered counter for database nova_cell1 Sep 09 23:01:42.170468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:01:42.172211 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:01:42.179029 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:01:42.181064 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:01:42.272156 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO dbcounter [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Registered counter for database nova_cell0 Sep 09 23:01:42.280280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:01:42.284863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:01:42.327142 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Registered counter for database nova_cell0 Sep 09 23:01:42.334341 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:01:42.339034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:01:42.608766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:01:42.616062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:01:42.658106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:01:42.665953 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:01:42.962054 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:01:42.968308 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-42a77046-307a-4051-a9e2-8be7674a2ebe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:01:42.973757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561ea708f9c0 pid: 120598 (default app) Sep 09 23:01:43.008531 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:01:43.014501 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-6292b13b-b7d6-490d-8d3a-646aedc0f4fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:01:43.019778 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ea708f9c0 pid: 120603 (default app) Sep 09 23:02:20.582695 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:20.584429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:20.586014 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:20.587023 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:21.072177 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6339aa43-0689-4f94-a12d-f71a9a167060 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced0427940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:21.995580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6339aa43-0689-4f94-a12d-f71a9a167060 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/784df3b3-679f-43d0-9f1f-8d3706689641" status: 200 len: 351 microversion: 2.1 time: 1.425083 Sep 09 23:02:21.996196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1/1] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:02:20 2022] GET /compute/v2.1/os-volumes/784df3b3-679f-43d0-9f1f-8d3706689641 => generated 351 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:02:24.308538 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9cbca251-9ce1-4333-9878-d56db9d0ebcc tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced041c4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:24.341584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:24.342980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:24.344406 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:24.345505 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:24.872054 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9cbca251-9ce1-4333-9878-d56db9d0ebcc tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/bbe2064b-7577-4937-a71a-1a57c70e786d" status: 200 len: 350 microversion: 2.1 time: 0.896379 Sep 09 23:02:24.881257 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1/2] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:02:23 2022] GET /compute/v2.1/os-volumes/bbe2064b-7577-4937-a71a-1a57c70e786d => generated 350 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:26.788955 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e05e3752-9a33-4310-bf6b-0fa14ff075fe tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced022c280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:26.878286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e05e3752-9a33-4310-bf6b-0fa14ff075fe tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/38a36846-6f36-4d74-8f7f-9a8327b4ca4e" status: 200 len: 351 microversion: 2.1 time: 0.094244 Sep 09 23:02:26.893853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:02:26 2022] GET /compute/v2.1/os-volumes/38a36846-6f36-4d74-8f7f-9a8327b4ca4e => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:26.894603 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3ed1b6a-37f1-4c43-8472-bcf77dadd7fc tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced02311f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:27.088015 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3ed1b6a-37f1-4c43-8472-bcf77dadd7fc tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.198091 Sep 09 23:02:27.088899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1134 bytes} [Fri Sep 9 23:02:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:02:27.108874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fac7998b-b036-4680-97d0-f4ee0b350cf6 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced022c940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:27.355168 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fac7998b-b036-4680-97d0-f4ee0b350cf6 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.250420 Sep 09 23:02:27.374422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1149 bytes} [Fri Sep 9 23:02:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:27.377309 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f2370cd-3775-48d6-8926-07a3df0e6f3e tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced024b160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:27.619915 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f2370cd-3775-48d6-8926-07a3df0e6f3e tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.249965 Sep 09 23:02:27.629382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1134 bytes} [Fri Sep 9 23:02:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:02:27.636810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d5a53f2-81a3-43e6-bb2f-ca48e9738cb9 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced022c550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:27.855691 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d5a53f2-81a3-43e6-bb2f-ca48e9738cb9 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.217654 Sep 09 23:02:27.856929 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1167 bytes} [Fri Sep 9 23:02:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:27.874153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1734b62d-c24f-4681-9a20-aecf597b8b71 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced024b940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:28.123234 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1734b62d-c24f-4681-9a20-aecf597b8b71 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.253113 Sep 09 23:02:28.143632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1170 bytes} [Fri Sep 9 23:02:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:28.145392 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e06ee955-b75f-4e6b-8747-8f9c176aea9f tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced02514c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:28.279909 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e06ee955-b75f-4e6b-8747-8f9c176aea9f tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.144222 Sep 09 23:02:28.303038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1155 bytes} [Fri Sep 9 23:02:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:28.305991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-757b6523-eb98-4a02-be7b-7e95617d7030 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced01d3280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:28.575691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-757b6523-eb98-4a02-be7b-7e95617d7030 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.283376 Sep 09 23:02:28.599289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb0bf1d4-2f1d-45a6-816d-996d53ee6fd4 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] Calling method '.version_select at 0x7fced022c790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:28.601468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1188 bytes} [Fri Sep 9 23:02:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:28.802471 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb0bf1d4-2f1d-45a6-816d-996d53ee6fd4 tempest-VolumesTestJSON-1797040734 tempest-VolumesTestJSON-1797040734-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.214574 Sep 09 23:02:28.813814 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1155 bytes} [Fri Sep 9 23:02:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:35.559014 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-441213917", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "networks": [{"uuid": "9a1aaab4-5e81-4f33-a319-5c184c756c6c"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:35.783582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] validate_networks() for [('9a1aaab4-5e81-4f33-a319-5c184c756c6c', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:02:36.939596 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88e7e4d9-31f2-4eeb-a13b-ffdf48f061f0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'create', calling method: .version_select at 0x7fced01dd160>, body: {"keypair": {"name": "tempest-keypair-1666799760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr63UyMVsz3OPMW4I5O4oq7fEpQFeWuSVncl4VUs6g2kAey+CsPJOh1Wb9f6QBVE/grMA//C5UVD+eR01Pw+Nib0ZOsTX9LId5d+4cvq5clcfAggzXA+1ifcP/U60eYMQ=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:37.065366 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-88e7e4d9-31f2-4eeb-a13b-ffdf48f061f0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Getting quotas for project 8084c097adde47ffadcacca8f4d3ea73. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:02:37.094149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-88e7e4d9-31f2-4eeb-a13b-ffdf48f061f0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Getting quotas for user eaef8f72768e4d1daf21257fdaf580d2 and project 8084c097adde47ffadcacca8f4d3ea73. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:02:37.206762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88e7e4d9-31f2-4eeb-a13b-ffdf48f061f0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.842211 Sep 09 23:02:37.207139 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 7/12] 10.222.0.17 () {62 vars in 1200 bytes} [Fri Sep 9 23:02:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 844 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 23:02:37.897253 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1920377803", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:38.104986 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] validate_networks() for [('8b6dd6ff-8b9d-48ad-87d2-8904fbbb0b3d', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:02:38.825089 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:02:38.826092 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:02:38.826698 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:02:38.827250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:02:38.827822 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:02:38.877436 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:38.882955 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:38.883627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:38.884554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:38.885173 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:38.889712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:38.990266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Getting quotas for project e966946c8e5a4e71803e8e37971160e1. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:02:39.018499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Getting quotas for user 56a554beedec4915b6ad1066823c8d4e and project e966946c8e5a4e71803e8e37971160e1. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:02:39.056635 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:02:39.071081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:02:39.385342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61a81ed2-947b-40f2-881d-b7709ef511be tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.614203 Sep 09 23:02:39.389831 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 6/13] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:02:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:02:40.007314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50a754f1-91c4-42c1-b009-6a9c0133d314 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: .version_select at 0x7fcecf8e1310>, body: {"keypair": {"name": "tempest-keypair-2027347708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJqe5Jf515od/qa7VekxU/7kf9Cqf11YjL2TR9k8+GOoLEs+i3Sk8ct+9CGhbmy8xh6ar5eLPfYz6khpHwJYXchA1906WZty4sTMuboqhs2WCG4j28DjLPg+GjzJNKGvA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:40.058472 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-50a754f1-91c4-42c1-b009-6a9c0133d314 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for project cba38c443abf49a48bdb55f42dac68b0. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:02:40.070148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-50a754f1-91c4-42c1-b009-6a9c0133d314 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for user 85cd8a90230b4c69886534be67acd943 and project cba38c443abf49a48bdb55f42dac68b0. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:02:40.155220 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50a754f1-91c4-42c1-b009-6a9c0133d314 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.763268 Sep 09 23:02:40.157466 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 7/14] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:02:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:40.461727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a2b0a75-2f8c-4a00-96af-341b8667bd3a tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Action: 'create', calling method: .version_select at 0x7fcecf8eb8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1526765963", "metadata": {"Type": "work"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a2b0a75-2f8c-4a00-96af-341b8667bd3a tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Request method failure captured: Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 122 Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YOi3eazpfTbUjIqfHox2n424GtHJnfkmSlWOd4B1Gu3VKDI6O1IbnoYOaqwi81INdS6Dg3xL2XYDPpAm1g-mR235ZMgqA-KKjvU_sLrRnhQo_-CCiLFhUbHcjmQxhWmBeOIQiJImW9fXKvy3272sIWmtoiUmwQuHuzSj5VxViHQ6k Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:02:40.479985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e3d66e24fa5401ea6853092fc4e4dff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 60ccdb8c2dc94916920ffa4efeb7c327 Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1526765963", "metadata": {"Type": "work"}}} Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: Sep 09 23:02:40.481210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1526765963', 'metadata': {'Type': 'work'}}}} Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:02:40.481887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 23:02:40.482962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 23:02:40.484615 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 23:02:40.484615 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.484615 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a2b0a75-2f8c-4a00-96af-341b8667bd3a tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:02:40.486602 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a2b0a75-2f8c-4a00-96af-341b8667bd3a tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.322062 Sep 09 23:02:40.489319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 8/15] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 9 23:02:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 330 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:02:40.497886 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8b0b176-ade2-48db-98a1-51393bbbaa66 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:40.502662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8b0b176-ade2-48db-98a1-51393bbbaa66 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:40.742101 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:02:40.747715 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:02:40.748946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:02:40.750487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:02:40.751053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:02:40.782840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:40.784616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:40.785225 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:40.786894 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:40.789815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:40.791613 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:40.858493 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8b0b176-ade2-48db-98a1-51393bbbaa66 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:40.878768 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Getting quotas for project d688ef3e358c4822823707982fe4f654. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:02:40.900605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Getting quotas for user e24e6fb4c69d48f7b2972b53fb8ea4a1 and project d688ef3e358c4822823707982fe4f654. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:02:40.943911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8b0b176-ade2-48db-98a1-51393bbbaa66 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1214 microversion: 2.1 time: 0.451790 Sep 09 23:02:40.948137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 9/16] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:40 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1214 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:40.960654 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:02:40.966617 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:02:40.969177 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e301ab3b-f3da-4b62-8eda-7a9b1ef2991a tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Action: 'create', calling method: .version_select at 0x7fcecf8cb040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-95395017", "metadata": {"Type": "work"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e301ab3b-f3da-4b62-8eda-7a9b1ef2991a tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Request method failure captured: Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 118 Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YOi3eazpfTbUjIqfHox2n424GtHJnfkmSlWOd4B1Gu3VKDI6O1IbnoYOaqwi81INdS6Dg3xL2XYDPpAm1g-mR235ZMgqA-KKjvU_sLrRnhQo_-CCiLFhUbHcjmQxhWmBeOIQiJImW9fXKvy3272sIWmtoiUmwQuHuzSj5VxViHQ6k Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:02:40.989732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e3d66e24fa5401ea6853092fc4e4dff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 60ccdb8c2dc94916920ffa4efeb7c327 Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-95395017", "metadata": {"Type": "work"}}} Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: Sep 09 23:02:40.991834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-95395017', 'metadata': {'Type': 'work'}}}} Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '0' Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:02:40.992554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 23:02:40.994103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 23:02:40.995240 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 23:02:40.995240 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.000065 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e301ab3b-f3da-4b62-8eda-7a9b1ef2991a tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:02:41.004105 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e301ab3b-f3da-4b62-8eda-7a9b1ef2991a tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.051680 Sep 09 23:02:41.008615 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 10/17] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 9 23:02:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:02:41.031956 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0899c83-95e4-40f8-9f88-c59158f80b0f tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Action: 'create', calling method: .version_select at 0x7fcecf874280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1708849397", "metadata": {"Type": "work"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0899c83-95e4-40f8-9f88-c59158f80b0f tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Request method failure captured: Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 119 Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YOi3eazpfTbUjIqfHox2n424GtHJnfkmSlWOd4B1Gu3VKDI6O1IbnoYOaqwi81INdS6Dg3xL2XYDPpAm1g-mR235ZMgqA-KKjvU_sLrRnhQo_-CCiLFhUbHcjmQxhWmBeOIQiJImW9fXKvy3272sIWmtoiUmwQuHuzSj5VxViHQ6k Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:02:41.044440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e3d66e24fa5401ea6853092fc4e4dff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 60ccdb8c2dc94916920ffa4efeb7c327 Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1708849397", "metadata": {"Type": "work"}}} Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: Sep 09 23:02:41.045677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1708849397', 'metadata': {'Type': 'work'}}}} Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '' Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:02:41.046392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 23:02:41.047583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 23:02:41.048677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 23:02:41.048677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.048677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0899c83-95e4-40f8-9f88-c59158f80b0f tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:02:41.048677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0899c83-95e4-40f8-9f88-c59158f80b0f tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032131 Sep 09 23:02:41.063950 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 11/18] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 9 23:02:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 23:02:41.074401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3acea58-cd4b-416f-b946-e9b46d06960e tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Calling method '.version_select at 0x7fcecf869160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:41.168310 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f3acea58-cd4b-416f-b946-e9b46d06960e tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] HTTP exception thrown: Volume tempest-invalid-16451308 could not be found. Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3acea58-cd4b-416f-b946-e9b46d06960e tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Request method failure captured: Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-16451308 HTTP/1.1 Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YOi3eazpfTbUjIqfHox2n424GtHJnfkmSlWOd4B1Gu3VKDI6O1IbnoYOaqwi81INdS6Dg3xL2XYDPpAm1g-mR235ZMgqA-KKjvU_sLrRnhQo_-CCiLFhUbHcjmQxhWmBeOIQiJImW9fXKvy3272sIWmtoiUmwQuHuzSj5VxViHQ6k Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:02:41.173011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e3d66e24fa5401ea6853092fc4e4dff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 60ccdb8c2dc94916920ffa4efeb7c327 Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Volume tempest-invalid-16451308 could not be found. Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'tempest-invalid-16451308'} Sep 09 23:02:41.174155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-16451308 could not be found. (HTTP 404) (Request-ID: req-e9cca93f-f97d-449c-94d4-2925f161a7d2) Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.175018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:02:41.176272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-16451308 could not be found. Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:02:41.177229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-16451308 could not be found. Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-16451308 could not be found. Sep 09 23:02:41.179980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.183640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3acea58-cd4b-416f-b946-e9b46d06960e tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Returning 404 to user: Volume tempest-invalid-16451308 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:02:41.184789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3acea58-cd4b-416f-b946-e9b46d06960e tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-16451308" status: 404 len: 97 microversion: 2.1 time: 0.114442 Sep 09 23:02:41.191482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 12/19] 10.222.0.17 () {58 vars in 1212 bytes} [Fri Sep 9 23:02:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-16451308 => generated 97 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 23:02:41.200521 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d666fca-9859-420d-a041-75bf88f5a128 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005695 Sep 09 23:02:41.206666 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32abbdc6-b8c7-4727-a981-5d53da5b43fe tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.997393 Sep 09 23:02:41.207318 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 8/20] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:02:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 3999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:02:41.227638 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 13/21] 10.222.0.17 () {58 vars in 1140 bytes} [Fri Sep 9 23:02:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 23:02:41.235592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd5a9e91-b3c4-4ad2-bbc4-4f64a20dc0d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:41.239542 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd5a9e91-b3c4-4ad2-bbc4-4f64a20dc0d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:41.253157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f5dc32b-2f30-43ea-b74a-0c4987a265be tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015419 Sep 09 23:02:41.262438 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 14/22] 10.222.0.17 () {58 vars in 1137 bytes} [Fri Sep 9 23:02:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 23:02:41.294984 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21a95b44-7908-477a-8f38-45aa4088fa00 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Calling method '.version_select at 0x7fcecf869310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:41.480308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-21a95b44-7908-477a-8f38-45aa4088fa00 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] HTTP exception thrown: Volume f2d5068a-a074-4443-8625-66d67bc0ab57 could not be found. Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21a95b44-7908-477a-8f38-45aa4088fa00 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Request method failure captured: Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-volumes/f2d5068a-a074-4443-8625-66d67bc0ab57 HTTP/1.1 Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YOi3eazpfTbUjIqfHox2n424GtHJnfkmSlWOd4B1Gu3VKDI6O1IbnoYOaqwi81INdS6Dg3xL2XYDPpAm1g-mR235ZMgqA-KKjvU_sLrRnhQo_-CCiLFhUbHcjmQxhWmBeOIQiJImW9fXKvy3272sIWmtoiUmwQuHuzSj5VxViHQ6k Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:02:41.482399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e3d66e24fa5401ea6853092fc4e4dff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 60ccdb8c2dc94916920ffa4efeb7c327 Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Volume f2d5068a-a074-4443-8625-66d67bc0ab57 could not be found. Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'f2d5068a-a074-4443-8625-66d67bc0ab57'} Sep 09 23:02:41.483897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2d5068a-a074-4443-8625-66d67bc0ab57 could not be found. (HTTP 404) (Request-ID: req-5dc544b2-feb8-4555-925d-928a48e15f43) Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.484607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:02:41.485998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2d5068a-a074-4443-8625-66d67bc0ab57 could not be found. Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 23:02:41.486952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2d5068a-a074-4443-8625-66d67bc0ab57 could not be found. Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2d5068a-a074-4443-8625-66d67bc0ab57 could not be found. Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21a95b44-7908-477a-8f38-45aa4088fa00 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Returning 404 to user: Volume f2d5068a-a074-4443-8625-66d67bc0ab57 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:02:41.488074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21a95b44-7908-477a-8f38-45aa4088fa00 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/f2d5068a-a074-4443-8625-66d67bc0ab57" status: 404 len: 109 microversion: 2.1 time: 0.209783 Sep 09 23:02:41.492433 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 15/23] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:02:41 2022] DELETE /compute/v2.1/os-volumes/f2d5068a-a074-4443-8625-66d67bc0ab57 => generated 109 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:02:41.508599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec5fdb63-cd58-42fa-a292-3147ff8cb8d9 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Calling method '.version_select at 0x7fcecf835c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:41.618141 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ec5fdb63-cd58-42fa-a292-3147ff8cb8d9 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] HTTP exception thrown: Volume 0b50e8e5-62c7-4489-b1aa-851cf5180d5c could not be found. Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec5fdb63-cd58-42fa-a292-3147ff8cb8d9 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Request method failure captured: Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/os-volumes/0b50e8e5-62c7-4489-b1aa-851cf5180d5c HTTP/1.1 Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YOi3eazpfTbUjIqfHox2n424GtHJnfkmSlWOd4B1Gu3VKDI6O1IbnoYOaqwi81INdS6Dg3xL2XYDPpAm1g-mR235ZMgqA-KKjvU_sLrRnhQo_-CCiLFhUbHcjmQxhWmBeOIQiJImW9fXKvy3272sIWmtoiUmwQuHuzSj5VxViHQ6k Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:02:41.620316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e3d66e24fa5401ea6853092fc4e4dff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e3d66e24fa5401ea6853092fc4e4dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 1e3d66e24fa5401ea6853092fc4e4dff Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1734256334 Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 60ccdb8c2dc94916920ffa4efeb7c327 Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1734256334-project Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Volume 0b50e8e5-62c7-4489-b1aa-851cf5180d5c could not be found. Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '0b50e8e5-62c7-4489-b1aa-851cf5180d5c'} Sep 09 23:02:41.621434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b50e8e5-62c7-4489-b1aa-851cf5180d5c could not be found. (HTTP 404) (Request-ID: req-ced75972-b662-4ae4-933f-1f53ecfeacf1) Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.622137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:02:41.623164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b50e8e5-62c7-4489-b1aa-851cf5180d5c could not be found. Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 23:02:41.626839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b50e8e5-62c7-4489-b1aa-851cf5180d5c could not be found. Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b50e8e5-62c7-4489-b1aa-851cf5180d5c could not be found. Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec5fdb63-cd58-42fa-a292-3147ff8cb8d9 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] Returning 404 to user: Volume 0b50e8e5-62c7-4489-b1aa-851cf5180d5c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:02:41.629949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec5fdb63-cd58-42fa-a292-3147ff8cb8d9 tempest-VolumesNegativeTest-1734256334 tempest-VolumesNegativeTest-1734256334-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0b50e8e5-62c7-4489-b1aa-851cf5180d5c" status: 404 len: 109 microversion: 2.1 time: 0.128246 Sep 09 23:02:41.635261 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 16/24] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:02:41 2022] GET /compute/v2.1/os-volumes/0b50e8e5-62c7-4489-b1aa-851cf5180d5c => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:02:41.703957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd5a9e91-b3c4-4ad2-bbc4-4f64a20dc0d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:41.781285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd5a9e91-b3c4-4ad2-bbc4-4f64a20dc0d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1222 microversion: 2.1 time: 0.562630 Sep 09 23:02:41.803986 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 9/25] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:41 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1222 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:41.978170 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb346339-4b17-4944-aa38-f5aab7e216ce tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:41.979117 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb346339-4b17-4944-aa38-f5aab7e216ce tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:42.204678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1328326907", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:42.411413 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] validate_networks() for [('8b6dd6ff-8b9d-48ad-87d2-8904fbbb0b3d', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:02:43.012364 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb346339-4b17-4944-aa38-f5aab7e216ce tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:43.020954 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb346339-4b17-4944-aa38-f5aab7e216ce tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1214 microversion: 2.1 time: 1.047165 Sep 09 23:02:43.031544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 17/26] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:41 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1214 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:02:44.060787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:44.061536 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:44.091264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:44.093493 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:44.096683 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:44.103667 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:44.113715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:44.115170 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:44.602819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:02:44.604406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:02:44.605083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:02:44.605702 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:02:44.606301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:02:44.623694 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:44.625078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:44.633326 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:44.634426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:44.635252 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:44.635935 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:44.648953 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:44.681458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a789202c-9886-4d95-a733-8de763d3666b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1274 microversion: 2.1 time: 0.627224 Sep 09 23:02:44.691169 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 18/27] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:44 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1274 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:44.695438 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Getting quotas for project d688ef3e358c4822823707982fe4f654. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:02:44.711312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Getting quotas for user e24e6fb4c69d48f7b2972b53fb8ea4a1 and project d688ef3e358c4822823707982fe4f654. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:02:44.740135 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:02:44.743520 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:02:44.890493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6a12351-458d-4fd4-b41e-9f49294f1e30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.693290 Sep 09 23:02:44.893826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 10/28] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:02:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:02:44.905229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3daf2cf-b933-48ed-a45f-57f5760c9b60 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:44.905847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c3daf2cf-b933-48ed-a45f-57f5760c9b60 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:45.247181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c3daf2cf-b933-48ed-a45f-57f5760c9b60 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:45.255616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1022584515", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1317db-d467-415d-ab18-3336278fd50c"}], "security_groups": [{"name": "tempest-securitygroup--958649457"}], "key_name": "tempest-keypair-2027347708", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:45.268233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3daf2cf-b933-48ed-a45f-57f5760c9b60 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1222 microversion: 2.1 time: 0.366813 Sep 09 23:02:45.268961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 19/29] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:44 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1222 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:45.707205 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:45.708101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:45.724263 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:45.728942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:45.729412 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:45.730162 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:45.730628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:45.731061 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:45.839997 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] validate_networks() for [('2c1317db-d467-415d-ab18-3336278fd50c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:02:45.997785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:46.019701 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cde263c5-1b86-47f0-8fe3-620057418217 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1272 microversion: 2.1 time: 0.317857 Sep 09 23:02:46.026545 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 20/30] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:45 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:46.080928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-617117369", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "335d2839-6b04-4246-8754-db29f039c550"}], "security_groups": [{"name": "tempest-securitygroup--2057952127"}], "key_name": "tempest-keypair-1666799760", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:46.569520 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] validate_networks() for [('335d2839-6b04-4246-8754-db29f039c550', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:02:48.477365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:02:48.477921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:02:48.478442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:02:48.478967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:02:48.479272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:02:48.495194 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:48.498016 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:48.500095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:48.501173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:48.504169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:48.504818 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:48.554046 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for project cba38c443abf49a48bdb55f42dac68b0. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:02:48.563170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for user 85cd8a90230b4c69886534be67acd943 and project cba38c443abf49a48bdb55f42dac68b0. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:02:48.609692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:02:48.624478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:02:48.803778 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9990ba9-be8f-4d1c-adbc-627f15f34988 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.564619 Sep 09 23:02:48.811264 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 11/31] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:02:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 3573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:02:48.826876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:48.828234 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:48.847350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:48.848213 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:48.848827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:48.850343 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:48.850962 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:48.851605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:48.932761 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:49.538722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:49.592208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6d0f111-05e0-4e9a-aa44-e8b54924f7ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1280 microversion: 2.1 time: 0.776389 Sep 09 23:02:49.593437 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 12/32] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:48 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1280 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:49.599225 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:49.600684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:49.607405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:49.607987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:49.608432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:49.609128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:49.609868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:49.610455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:49.723524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:02:49.724060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:02:49.724539 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:02:49.725063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:02:49.725555 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:02:49.751392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:49.752335 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:49.757573 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:49.759954 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:49.761044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:49.761695 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:49.832141 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Getting quotas for project 8084c097adde47ffadcacca8f4d3ea73. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:02:49.851532 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Getting quotas for user eaef8f72768e4d1daf21257fdaf580d2 and project 8084c097adde47ffadcacca8f4d3ea73. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:02:49.909544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:02:49.919427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:02:50.211468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f38f8297-8670-4f9f-9ab4-713ba305a6c2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.135419 Sep 09 23:02:50.223844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 21/33] 10.222.0.17 () {62 vars in 1188 bytes} [Fri Sep 9 23:02:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 4148 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 09 23:02:50.230982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:50.231114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:50.304264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:50.308383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:50.309821 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:50.317972 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:50.319854 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:50.321529 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:50.578762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:50.591397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0da13cf-c6f2-44c9-b731-e59c6494645d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1238 microversion: 2.1 time: 0.366350 Sep 09 23:02:50.592360 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 22/34] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:50 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1238 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:50.604316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e59adc2c-bab4-4ab8-8c11-03fede36506d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:50.604948 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e59adc2c-bab4-4ab8-8c11-03fede36506d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:51.015579 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e59adc2c-bab4-4ab8-8c11-03fede36506d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:51.039365 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e59adc2c-bab4-4ab8-8c11-03fede36506d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:51.052258 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e59adc2c-bab4-4ab8-8c11-03fede36506d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:51.057161 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e59adc2c-bab4-4ab8-8c11-03fede36506d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1281 microversion: 2.20 time: 0.461950 Sep 09 23:02:51.064551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 23/35] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:02:50 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1281 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:02:51.087095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:51.087838 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:51.122119 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:51.122693 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:51.125728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:51.128062 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:51.132125 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:51.133345 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:51.509462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:51.525032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ff4ee862-27da-4b1c-bcb2-8d841be92151 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 1.929906 Sep 09 23:02:51.535471 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 13/36] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:49 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:51.617998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:51.619055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:51.632946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:51.638397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:51.639123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:51.644386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:51.644929 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:51.647742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:51.654664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:51.690734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-825feb34-21c7-4bdf-8cd7-2adcc32ac847 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1280 microversion: 2.1 time: 0.624800 Sep 09 23:02:51.695871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 24/37] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:51 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1280 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:51.984793 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:51.993024 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-638f92b2-a41e-4cc9-bc2b-bf978c28d827 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1294 microversion: 2.1 time: 0.379929 Sep 09 23:02:51.997753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 14/38] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:51 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1294 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:52.086495 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:52.087468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:52.096627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:52.100551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:52.101677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:52.121314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:52.122138 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:52.124479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:52.552011 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:52.554330 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:52.574809 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:52.576433 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:52.577185 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:52.579766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:52.583221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:52.584001 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:52.665294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:52.689374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:52.691952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:52.695359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ad26b7e-732c-4a38-a6e2-f69c8f9c46df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1285 microversion: 2.20 time: 0.613993 Sep 09 23:02:52.697494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 25/39] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:02:52 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1285 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:02:52.729655 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:52.730616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:52.738796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:52.740169 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:52.741510 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:52.742445 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:52.743264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:52.743971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:52.930827 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:52.940826 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e01f618-f74b-4c94-85e3-5cac5c0ce5bf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1280 microversion: 2.1 time: 0.218134 Sep 09 23:02:52.948095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 26/40] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:52 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1280 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:53.030140 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:53.032802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:53.080303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:53.080818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:53.082215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:53.086143 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:53.088838 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:53.092407 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:53.389675 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:53.403630 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee9736a9-d23a-48e0-b093-36c20b84476f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.855790 Sep 09 23:02:53.444396 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 15/41] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:52 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:02:53.723066 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:53.725462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:53.736235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:53.739629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:53.745294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:53.746325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:53.747035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:53.747765 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:53.833812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:53.844882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d90c9fa4-c0a7-480b-871b-70a17cde7062 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1300 microversion: 2.1 time: 0.827401 Sep 09 23:02:53.855391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 27/42] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:53 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1300 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:02:53.979074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:53.980063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:53.991576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:53.993520 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:53.995266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:53.999275 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:54.000879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:54.003095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:54.554230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:54.562211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:54.563823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:54.564840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03e44224-356b-499c-8b7a-c2a9013782f2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1333 microversion: 2.20 time: 0.846533 Sep 09 23:02:54.565391 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 16/43] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:02:53 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1333 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:02:54.589570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:54.590292 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:54.613802 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:54.614308 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:54.616111 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:54.616825 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:54.617387 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:54.617691 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:54.897875 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:54.908453 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4cc6bb20-7fb8-4509-9138-77180d9be60e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.934950 Sep 09 23:02:54.919770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 28/44] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:53 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:54.925126 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:54.926080 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:54.948848 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:54.949296 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:54.949755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:54.950476 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:54.950971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:54.951393 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:55.485629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:55.499605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d564bfe-540e-4b74-9453-58412d088521 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.933085 Sep 09 23:02:55.502623 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 17/45] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:54 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:55.732197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:55.747322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40652a5b-288d-4971-b8c1-0f950fb5f1a5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1300 microversion: 2.1 time: 0.830185 Sep 09 23:02:55.753172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 29/46] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:54 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1300 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:55.777161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-69afa3bd-21da-40a0-aa5c-b8c062e7a775 req-07c99fb7-549f-4e17-a78f-805e172e1784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675371e9-d81e-4019-a0ea-bf2c10fc0e81", "tag": "cf2d7648-76c0-400a-9e40-8ebf9db74ec0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:55.805239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:55.805951 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:55.826392 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-69afa3bd-21da-40a0-aa5c-b8c062e7a775 req-07c99fb7-549f-4e17-a78f-805e172e1784 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:55.826947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-69afa3bd-21da-40a0-aa5c-b8c062e7a775 req-07c99fb7-549f-4e17-a78f-805e172e1784 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:55.827430 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-69afa3bd-21da-40a0-aa5c-b8c062e7a775 req-07c99fb7-549f-4e17-a78f-805e172e1784 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:55.833626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:55.834174 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:55.834653 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:55.843457 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:55.843924 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:55.847673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:55.929761 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-69afa3bd-21da-40a0-aa5c-b8c062e7a775 req-07c99fb7-549f-4e17-a78f-805e172e1784 service nova] Creating event network-changed:cf2d7648-76c0-400a-9e40-8ebf9db74ec0 for instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 on hv-cinder-85221 Sep 09 23:02:55.930372 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-69afa3bd-21da-40a0-aa5c-b8c062e7a775 req-07c99fb7-549f-4e17-a78f-805e172e1784 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 23:02:55.930829 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-69afa3bd-21da-40a0-aa5c-b8c062e7a775 req-07c99fb7-549f-4e17-a78f-805e172e1784 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 23:02:55.931999 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:55.945805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:55.946261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:55.949536 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:55.950037 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:55.950480 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:55.989007 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.compute.rpcapi [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 23:02:55.990050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] Releasing lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 23:02:56.025077 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87648822-d3ed-4aa4-9742-ba25116e61df None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.514662 Sep 09 23:02:56.026782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 18/47] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:56.040370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:56.040370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:56.061001 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:56.063599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:56.064161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:56.064972 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:56.066039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:56.067170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:56.197038 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:56.212810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:56.214330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:56.219086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aef750ee-14e2-4074-a2ce-ebdb3b0b6c2f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1339 microversion: 2.20 time: 0.435425 Sep 09 23:02:56.221972 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 30/48] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:02:55 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1339 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:02:56.534476 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:56.536245 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:56.551923 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:56.553352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:56.555140 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:56.560858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:56.562833 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:56.564404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:56.938316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:56.948755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91407e8e-37f1-43df-80dc-9bd6cb190f28 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.919645 Sep 09 23:02:56.959617 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 19/49] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:56 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:56.981267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:56.988319 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:57.020619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:57.021475 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:57.021946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:57.026629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:57.027294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:57.027832 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:57.315236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:57.324145 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ee16013-1be4-4ada-87c0-22d67ee2bb82 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1300 microversion: 2.1 time: 0.363133 Sep 09 23:02:57.327696 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 20/50] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:56 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1300 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:57.350560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:57.351301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:57.359771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:57.377320 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:57.378112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:57.378887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:57.379365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:57.379938 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:57.581385 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:57.596684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:57.601154 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:57.602451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0cc791ae-9268-4857-8d10-b203964db7a5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1339 microversion: 2.20 time: 0.273741 Sep 09 23:02:57.606674 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 21/51] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:02:57 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1339 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:02:57.991391 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:57.993864 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:58.014112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:58.023569 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:58.026742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:58.028825 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:58.029507 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:58.030230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:58.235077 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:58.244677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb742514-d887-4eff-b4d3-eb342f60bd07 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 1.716894 Sep 09 23:02:58.272942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 31/52] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:56 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:58.597844 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=24 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:02:58.815773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-bc8f492d-a5f9-4d3d-a43c-f43b012d5dd1 req-f7948bc7-193f-4a97-9fc0-02b4f762aba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "645207f3-4aff-46ce-8998-aae640598f3b", "tag": "47fb4751-46e9-49ab-8451-6f742ecce574"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:58.872353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bc8f492d-a5f9-4d3d-a43c-f43b012d5dd1 req-f7948bc7-193f-4a97-9fc0-02b4f762aba7 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:58.873011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bc8f492d-a5f9-4d3d-a43c-f43b012d5dd1 req-f7948bc7-193f-4a97-9fc0-02b4f762aba7 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:58.874757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bc8f492d-a5f9-4d3d-a43c-f43b012d5dd1 req-f7948bc7-193f-4a97-9fc0-02b4f762aba7 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:58.951474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-bc8f492d-a5f9-4d3d-a43c-f43b012d5dd1 req-f7948bc7-193f-4a97-9fc0-02b4f762aba7 service nova] Creating event network-changed:47fb4751-46e9-49ab-8451-6f742ecce574 for instance 645207f3-4aff-46ce-8998-aae640598f3b on hv-cinder-85221 Sep 09 23:02:58.953676 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bc8f492d-a5f9-4d3d-a43c-f43b012d5dd1 req-f7948bc7-193f-4a97-9fc0-02b4f762aba7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 23:02:58.955274 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bc8f492d-a5f9-4d3d-a43c-f43b012d5dd1 req-f7948bc7-193f-4a97-9fc0-02b4f762aba7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 23:02:58.960800 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:58.962602 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:58.965696 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:58.966876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:58.968620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:58.970780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:58.999553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.compute.rpcapi [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 23:02:59.004344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] Releasing lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 23:02:59.046568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc08315e-d6d4-4812-ab0a-2c4e7890bd9c None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.769269 Sep 09 23:02:59.049528 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 32/53] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:59.066818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:59.070369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:59.090803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:59.093121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:59.094514 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:59.098333 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:59.102051 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:59.104066 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:59.154548 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:59.163251 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-08d68ce5-fb3d-4c95-8777-0f9135c0c1b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 1.183871 Sep 09 23:02:59.171008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 22/54] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:57 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:02:59.184805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:59.191774 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:59.204256 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:59.207622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:59.208250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:59.209785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:59.212654 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:59.213743 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:59.418660 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:59.443721 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:59.450298 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:02:59.452901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4658eacb-1c70-4575-bf00-181313dc4927 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1339 microversion: 2.20 time: 0.280429 Sep 09 23:02:59.456213 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 23/55] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:02:59 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1339 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:02:59.477521 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8c496b42-c1ae-467d-afa9-81634258df40 req-97fa7a4a-4307-475a-a3df-b5be9a634033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424d37d5-0527-4e4c-8a5f-e2b37084c377", "tag": "305a5529-c5e4-4c1c-b702-2efb42e3dc58"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:02:59.506595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8c496b42-c1ae-467d-afa9-81634258df40 req-97fa7a4a-4307-475a-a3df-b5be9a634033 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:59.507354 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8c496b42-c1ae-467d-afa9-81634258df40 req-97fa7a4a-4307-475a-a3df-b5be9a634033 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:59.508166 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8c496b42-c1ae-467d-afa9-81634258df40 req-97fa7a4a-4307-475a-a3df-b5be9a634033 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:59.541876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8c496b42-c1ae-467d-afa9-81634258df40 req-97fa7a4a-4307-475a-a3df-b5be9a634033 service nova] Creating event network-changed:305a5529-c5e4-4c1c-b702-2efb42e3dc58 for instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 on hv-cinder-85221 Sep 09 23:02:59.560476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8c496b42-c1ae-467d-afa9-81634258df40 req-97fa7a4a-4307-475a-a3df-b5be9a634033 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102935 Sep 09 23:02:59.562263 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 24/56] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:02:59.570292 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:02:59.579329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:02:59.589277 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:59.589772 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:59.590234 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:02:59.590975 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:02:59.591449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:02:59.591932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:00.332481 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:00.344714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c7f2936-5e9d-4a28-9b4c-49d477d677cd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.780123 Sep 09 23:03:00.348497 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 25/57] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:59 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:00.358178 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:00.358848 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:00.373899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:00.374316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:00.382926 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:00.384121 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:00.384853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:00.385524 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:00.525943 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:00.541606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebb1c95c-0771-4de5-a695-00aee00a2647 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 1.487802 Sep 09 23:03:00.544218 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 33/58] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:02:59 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:00.553323 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:00.554243 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:00.563749 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:00.564651 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:00.565252 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:00.566190 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:00.566823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:00.567412 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:00.701028 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:00.709231 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c6559010-d5c1-4cb9-a041-6d150f39bb71 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.358595 Sep 09 23:03:00.710133 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 26/59] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:00 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:01.033362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=24 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:01.344674 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:01.359757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:01.363711 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:01.367295 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1363817-8a74-4a3e-89eb-0084a066b0c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.821474 Sep 09 23:03:01.369643 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 34/60] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:00 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:01.374296 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:01.375239 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:01.386163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:01.387373 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:01.388075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:01.389614 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:01.390294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:01.394869 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:01.570871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:01.572142 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:01.583637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:01.587181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:01.587835 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:01.590123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:01.591458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:01.592131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:01.761537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:01.773503 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-75a9adaf-db55-4f36-a3c8-28a0a1dfb6f6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.404486 Sep 09 23:03:01.774094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 27/61] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:01 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:01.794492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:01.795347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:01.805220 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:01.822634 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:01.824325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:01.831425 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:01.835101 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:01.835626 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:01.836357 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:01.895795 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:02.031696 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:02.041978 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cfad7a05-7dc8-4f2c-b791-43969792602f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.266668 Sep 09 23:03:02.044509 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 28/62] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:01 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:02.122711 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:02.138664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c6f4b6b0-0e3f-4e59-9dae-053f403f707e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.573148 Sep 09 23:03:02.155929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 35/63] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:01 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:02.394612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:02.395445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:02.402988 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:02.403945 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:02.404573 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:02.405478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:02.406159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:02.407015 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:02.475013 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fbff88ee-da77-486a-9a12-f3fd0ed6fbc6 req-3c9cdd80-0598-4a45-857a-02d4eaae1f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04df6bca-4a68-4c7c-a314-ab08a28dfec3", "tag": "a1982a7e-608a-4e41-ae98-2ee9fbdcdf4f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:02.490904 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fbff88ee-da77-486a-9a12-f3fd0ed6fbc6 req-3c9cdd80-0598-4a45-857a-02d4eaae1f56 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:02.491409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fbff88ee-da77-486a-9a12-f3fd0ed6fbc6 req-3c9cdd80-0598-4a45-857a-02d4eaae1f56 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:02.491858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fbff88ee-da77-486a-9a12-f3fd0ed6fbc6 req-3c9cdd80-0598-4a45-857a-02d4eaae1f56 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:02.520871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fbff88ee-da77-486a-9a12-f3fd0ed6fbc6 req-3c9cdd80-0598-4a45-857a-02d4eaae1f56 service nova] Creating event network-changed:a1982a7e-608a-4e41-ae98-2ee9fbdcdf4f for instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 on hv-cinder-85221 Sep 09 23:03:02.533343 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fbff88ee-da77-486a-9a12-f3fd0ed6fbc6 req-3c9cdd80-0598-4a45-857a-02d4eaae1f56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062593 Sep 09 23:03:02.534324 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 36/64] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:02.613967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:02.629982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:02.632178 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:02.634136 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39f65276-83da-4f1a-bafd-e9bc714098fa tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.243775 Sep 09 23:03:02.652688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 29/65] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:02 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:02.801273 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:02.801976 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:02.819854 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:02.820355 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:02.820803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:02.821502 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:02.822111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:02.822686 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:03.066597 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:03.067454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:03.079936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:03.082893 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:03.084353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:03.088225 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:03.089864 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:03.090578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:03.226983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:03.230955 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:03.239071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cbfa5963-b13b-49b0-af0b-6fd751127b08 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.442207 Sep 09 23:03:03.254677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 37/66] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:02 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:03.260443 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:03.261374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:03.267787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:03.268581 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:03.269223 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:03.270129 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:03.270818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:03.272109 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:03.329054 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:03.338924 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2552a2a4-7e9f-4edc-bc53-d2df9163047d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.276294 Sep 09 23:03:03.339525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 30/67] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:03 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:03.606540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:03.616509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e85e462-e019-4a28-a675-caeabc0acd6d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.359753 Sep 09 23:03:03.621369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 38/68] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:03 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:03.661532 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:03.663272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:03.677422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:03.678661 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:03.684172 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:03.685365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:03.686619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:03.687848 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:04.013405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:04.027906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:04.034431 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:04.035785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31abd315-3019-4485-9ed6-3dad8835a4f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.378003 Sep 09 23:03:04.037536 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 31/69] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:03 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:04.263387 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:04.264642 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:04.281631 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:04.283474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:04.285416 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:04.286279 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:04.287876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:04.288477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:04.289207 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:04.361174 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:04.362257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:04.375073 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:04.376156 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:04.376602 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:04.377655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:04.378111 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:04.378535 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:04.556459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:04.564243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26e51e28-10d7-400a-813b-e62aba562376 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.207092 Sep 09 23:03:04.583111 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 32/70] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:04 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:04.594828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-7ea79947-04e1-4fc9-aea7-edfa8e99f6d2 req-1cd97fee-bee3-460a-b5dd-2b4943e3bb34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2052a904-5812-447c-b0ac-d3c9dc4321cb", "tag": "37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:04.606519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7ea79947-04e1-4fc9-aea7-edfa8e99f6d2 req-1cd97fee-bee3-460a-b5dd-2b4943e3bb34 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:04.607005 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7ea79947-04e1-4fc9-aea7-edfa8e99f6d2 req-1cd97fee-bee3-460a-b5dd-2b4943e3bb34 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:04.607432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7ea79947-04e1-4fc9-aea7-edfa8e99f6d2 req-1cd97fee-bee3-460a-b5dd-2b4943e3bb34 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:04.622650 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7ea79947-04e1-4fc9-aea7-edfa8e99f6d2 req-1cd97fee-bee3-460a-b5dd-2b4943e3bb34 service nova] Creating event network-changed:37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba for instance 2052a904-5812-447c-b0ac-d3c9dc4321cb on hv-cinder-85221 Sep 09 23:03:04.627852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-7ea79947-04e1-4fc9-aea7-edfa8e99f6d2 req-1cd97fee-bee3-460a-b5dd-2b4943e3bb34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037772 Sep 09 23:03:04.628753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 33/71] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:04.649882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:04.650604 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:04.658979 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:04.659474 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:04.659933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:04.660632 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:04.661512 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:04.662739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:04.843311 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:04.853317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4bf1df98-00a7-4723-9355-6022c033dcf7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.207675 Sep 09 23:03:04.867513 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 34/72] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:04 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:05.070170 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:05.073757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:05.075585 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:05.098950 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:05.100459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f980f14b-8167-4e32-83a2-b504c8fe68c0 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.838444 Sep 09 23:03:05.101927 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:05.103068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 39/73] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:04 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:05.103917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:05.105144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:05.106150 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:05.107522 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:05.346539 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:05.364267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:05.368399 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:05.372605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0f47b71-9a49-42fe-bcbc-f3077ae23582 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.310904 Sep 09 23:03:05.396122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 35/74] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:05 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:05.600664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:05.602569 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:05.627407 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:05.629524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:05.631940 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:05.632758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:05.633314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:05.634592 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:05.876947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:05.877569 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:05.887551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:05.888032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:05.889786 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:05.890543 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:05.891017 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:05.891452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:05.981251 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:06.075118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:06.084233 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b69c771d-42fd-4318-b704-a91732179741 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.210988 Sep 09 23:03:06.086783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 36/75] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:05 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:06.127049 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:06.128402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:06.136706 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:06.137262 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:06.137693 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:06.138384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:06.138988 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:06.139710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:06.310250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:06.321411 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e27c2088-0053-4523-adc7-5a6f802f6d44 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.198190 Sep 09 23:03:06.322517 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 37/76] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:06 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:06.415429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:06.416138 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:06.437517 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:06.438281 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:06.438940 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:06.439914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:06.440728 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:06.441333 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:06.529978 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:06.541020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14e58526-3047-40a2-ab4d-e83b8cfb437a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.954788 Sep 09 23:03:06.558016 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 40/77] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:05 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:06.695123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:06.704619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:06.706208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:06.707689 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30c67430-7ee9-4a05-852c-98ed060e3bb4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.299740 Sep 09 23:03:06.708931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 38/78] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:06 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:07.121948 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:07.125154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:07.141250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:07.142241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:07.143188 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:07.144901 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:07.147286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:07.148028 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:07.350421 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:07.351674 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:07.359919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:07.360408 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:07.362103 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:07.362838 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:07.369957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:07.370519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:07.676531 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:07.689560 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e0812a0-360b-4752-8b88-2b112729e9ec tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.583438 Sep 09 23:03:07.690794 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 41/79] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:07 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:07.718317 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:07.720167 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:07.721548 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:07.737881 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2e5b047-7095-4801-aced-2863caba90aa tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.394951 Sep 09 23:03:07.739669 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 39/80] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:07 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:07.743818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:07.744673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:07.746236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:07.748199 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:07.750858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:07.751458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:07.751668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:07.753562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:07.773228 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:07.778491 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:07.780290 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:07.782831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:07.783417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:07.785811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:07.986192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:07.997901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:07.999840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:08.001430 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09a4e855-b33c-4485-a777-407599da8f75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.259620 Sep 09 23:03:08.002575 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 40/81] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:07 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:08.189140 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:08.200465 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0615dcc-fe22-4463-aaf9-b13fb43b683b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.508286 Sep 09 23:03:08.201255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 42/82] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:07 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:08.716782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:08.718098 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:08.725047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:08.725534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:08.726211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:08.738738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:08.739239 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:08.739745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:08.772048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:08.772658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:08.790299 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:08.790796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:08.791427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:08.792169 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:08.792619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:08.793194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:08.970884 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:08.981125 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20742daf-d161-4df5-a75d-e19eabc658b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.269324 Sep 09 23:03:08.983447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 41/83] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:08 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:08.989230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:09.026759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:09.028782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:09.029638 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:09.034436 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff72a932-00bc-42f5-aa39-099d4f53700f tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.266877 Sep 09 23:03:09.035272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 43/84] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:08 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:09.047738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:09.047738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:09.047738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:09.047738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:09.048043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:09.048043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:09.227241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:09.227759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:09.256391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:09.256981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:09.258300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:09.259943 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:09.261999 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:09.264058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:09.395005 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:09.413035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:09.421874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:09.426697 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4eba32af-6a64-4228-bd83-ecf357daad91 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.403643 Sep 09 23:03:09.432574 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 42/85] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:09 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:03:09.613187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:09.621805 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac7ee511-d6d9-4385-96d8-4218bf729c4e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.401142 Sep 09 23:03:09.641321 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 44/86] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:09 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:10.005634 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:10.010156 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:10.028188 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.028684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.033326 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.034537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.035875 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.036671 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.117030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cf37fb54-e8cf-45e4-b294-5c6243b24d35 req-016f8e65-895e-4cb9-8bb4-3e0333e6c3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645207f3-4aff-46ce-8998-aae640598f3b", "name": "network-vif-plugged", "status": "completed", "tag": "47fb4751-46e9-49ab-8451-6f742ecce574"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:10.139853 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cf37fb54-e8cf-45e4-b294-5c6243b24d35 req-016f8e65-895e-4cb9-8bb4-3e0333e6c3e4 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.141696 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cf37fb54-e8cf-45e4-b294-5c6243b24d35 req-016f8e65-895e-4cb9-8bb4-3e0333e6c3e4 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.142659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cf37fb54-e8cf-45e4-b294-5c6243b24d35 req-016f8e65-895e-4cb9-8bb4-3e0333e6c3e4 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.172855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cf37fb54-e8cf-45e4-b294-5c6243b24d35 req-016f8e65-895e-4cb9-8bb4-3e0333e6c3e4 service nova] Creating event network-vif-plugged:47fb4751-46e9-49ab-8451-6f742ecce574 for instance 645207f3-4aff-46ce-8998-aae640598f3b on hv-cinder-85221 Sep 09 23:03:10.183286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cf37fb54-e8cf-45e4-b294-5c6243b24d35 req-016f8e65-895e-4cb9-8bb4-3e0333e6c3e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151939 Sep 09 23:03:10.184538 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 45/87] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:10.190770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:10.191933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:10.200924 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.202045 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.202832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.203991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.204669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.205982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.344782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:10.364162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72b20cf4-95f0-4db2-9cf3-5563df2feac5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.351702 Sep 09 23:03:10.365328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 43/88] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:10 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:10.460791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:10.461587 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:10.470927 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.471546 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.472323 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.473232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.473865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.475075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.495128 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:10.508553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c903f4f-34c3-4278-bc1f-a69d53fc11d6 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.322456 Sep 09 23:03:10.509428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 46/89] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:10 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:10.649979 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:10.650591 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:10.666696 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.684362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.689247 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.690127 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:10.690619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:10.691059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:10.757812 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:10.773821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:10.775281 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:10.778622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c731cde7-465c-4cb7-9805-769663d47e03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.322273 Sep 09 23:03:10.779326 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 44/90] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:10 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:10.918299 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:10.926352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45991623-dfd2-4af6-8e7b-32a215c502cc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.280774 Sep 09 23:03:10.927135 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 47/91] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:10 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:11.389546 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:11.391224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:11.399833 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:11.400583 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:11.401216 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:11.402521 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:11.403188 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:11.403880 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:11.534802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:11.537498 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:11.555740 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:11.556734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:11.559511 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:11.561923 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:11.564437 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:11.569781 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:11.572369 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:11.584515 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:11.585557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ac86f3f-bc83-455d-9c62-183f99add6e8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.201555 Sep 09 23:03:11.588650 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 45/92] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:11 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:11.806370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:11.807350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:11.814355 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:11.815197 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:11.816268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:11.817380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:11.818745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:11.820165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:11.837330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:11.847958 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f92e412a-2dfc-4bf8-a714-767492da04c7 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.319070 Sep 09 23:03:11.849503 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 48/93] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:11 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:11.951270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:11.951914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:11.960345 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:11.961002 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:11.961657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:11.962763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:11.963449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:11.964130 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:11.984145 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:11.993016 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:11.994459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:11.995600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b73c9439-0670-455e-a4e0-14ee15e451f8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.194645 Sep 09 23:03:11.996163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 46/94] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:11 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:03:12.107077 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:12.115460 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-de84d0ca-b719-4a0f-a58c-fffe5faf2dd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.168173 Sep 09 23:03:12.116059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 49/95] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:11 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:12.205184 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6ccba39a-a7d8-4188-892b-bc1c14ab3d7f req-347124f9-215e-4164-807a-d778d2dec6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424d37d5-0527-4e4c-8a5f-e2b37084c377", "name": "network-vif-plugged", "status": "completed", "tag": "305a5529-c5e4-4c1c-b702-2efb42e3dc58"}, {"server_uuid": "675371e9-d81e-4019-a0ea-bf2c10fc0e81", "name": "network-vif-plugged", "status": "completed", "tag": "cf2d7648-76c0-400a-9e40-8ebf9db74ec0"}, {"server_uuid": "2052a904-5812-447c-b0ac-d3c9dc4321cb", "name": "network-vif-plugged", "status": "completed", "tag": "37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:12.216165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6ccba39a-a7d8-4188-892b-bc1c14ab3d7f req-347124f9-215e-4164-807a-d778d2dec6f1 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:12.216641 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6ccba39a-a7d8-4188-892b-bc1c14ab3d7f req-347124f9-215e-4164-807a-d778d2dec6f1 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:12.217069 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6ccba39a-a7d8-4188-892b-bc1c14ab3d7f req-347124f9-215e-4164-807a-d778d2dec6f1 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:12.231075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6ccba39a-a7d8-4188-892b-bc1c14ab3d7f req-347124f9-215e-4164-807a-d778d2dec6f1 service nova] Creating event network-vif-plugged:305a5529-c5e4-4c1c-b702-2efb42e3dc58 for instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 on hv-cinder-85221 Sep 09 23:03:12.231606 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6ccba39a-a7d8-4188-892b-bc1c14ab3d7f req-347124f9-215e-4164-807a-d778d2dec6f1 service nova] Creating event network-vif-plugged:cf2d7648-76c0-400a-9e40-8ebf9db74ec0 for instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 on hv-cinder-85221 Sep 09 23:03:12.232108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6ccba39a-a7d8-4188-892b-bc1c14ab3d7f req-347124f9-215e-4164-807a-d778d2dec6f1 service nova] Creating event network-vif-plugged:37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba for instance 2052a904-5812-447c-b0ac-d3c9dc4321cb on hv-cinder-85221 Sep 09 23:03:12.240506 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6ccba39a-a7d8-4188-892b-bc1c14ab3d7f req-347124f9-215e-4164-807a-d778d2dec6f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038406 Sep 09 23:03:12.241442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 47/96] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:12.610697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:12.611285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:12.618436 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:12.619248 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:12.620095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:12.620881 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:12.621426 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:12.621889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:12.802963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:12.811211 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f82982c4-8c17-401d-b540-dc7b429dbbc2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.204172 Sep 09 23:03:12.824154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 50/97] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:12 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:12.877463 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:12.878165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:12.888124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:12.889566 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:12.890307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:12.891212 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:12.892024 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:12.892974 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:13.034495 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:13.036702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:13.072968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:13.075518 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:13.076022 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:13.079081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:13.085015 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:13.085824 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:13.118086 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:13.136970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6eb86789-8a07-4a09-9b63-e2a98b41e97b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.264054 Sep 09 23:03:13.139275 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 48/98] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:12 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:13.156687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:13.157600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:13.172980 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:13.184915 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:13.186445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:13.187240 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:13.187751 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:13.188206 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:13.478843 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:13.487619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2c95407-3031-432c-aaaa-f387c854a3d9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.345873 Sep 09 23:03:13.488210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 49/99] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:13 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:13.674513 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:13.684064 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:13.685600 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:13.687293 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6a09a66-b298-473d-97f8-72eab18dc7c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.669460 Sep 09 23:03:13.688357 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 51/100] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:13 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:13.836760 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:13.837600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:13.843957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:13.844437 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:13.844873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:13.845575 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:13.846019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:13.846612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:14.006010 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:14.015914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab2722f7-6dd6-488e-a827-85e8f2169172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.183944 Sep 09 23:03:14.016595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 50/101] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:13 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:14.168700 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:14.169402 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:14.178428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:14.179098 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:14.179862 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:14.180769 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:14.181296 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:14.181847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:14.264001 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8fae74c3-afbd-4949-8547-4a803c696c9d req-e1b1aa71-4da7-441c-9dde-5f15ab429b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04df6bca-4a68-4c7c-a314-ab08a28dfec3", "name": "network-vif-plugged", "status": "completed", "tag": "a1982a7e-608a-4e41-ae98-2ee9fbdcdf4f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:14.277175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8fae74c3-afbd-4949-8547-4a803c696c9d req-e1b1aa71-4da7-441c-9dde-5f15ab429b25 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:14.278059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8fae74c3-afbd-4949-8547-4a803c696c9d req-e1b1aa71-4da7-441c-9dde-5f15ab429b25 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:14.278439 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8fae74c3-afbd-4949-8547-4a803c696c9d req-e1b1aa71-4da7-441c-9dde-5f15ab429b25 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:14.303684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8fae74c3-afbd-4949-8547-4a803c696c9d req-e1b1aa71-4da7-441c-9dde-5f15ab429b25 service nova] Creating event network-vif-plugged:a1982a7e-608a-4e41-ae98-2ee9fbdcdf4f for instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 on hv-cinder-85221 Sep 09 23:03:14.310081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8fae74c3-afbd-4949-8547-4a803c696c9d req-e1b1aa71-4da7-441c-9dde-5f15ab429b25 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054161 Sep 09 23:03:14.311268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 51/102] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:14.325612 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:14.335648 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ccb710c-8231-441a-86ca-49724a99428d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.170500 Sep 09 23:03:14.336452 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 52/103] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:14 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:14.514426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:14.515159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:14.524272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:14.524903 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:14.525491 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:14.526547 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:14.527152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:14.527769 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:14.702873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:14.711562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-906b18c0-6852-4aa1-af5b-ac19e9a0d7ed tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1322 microversion: 2.1 time: 0.201068 Sep 09 23:03:14.712739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 52/104] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:14 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:14.723801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:14.724923 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:14.731031 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:14.731632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:14.732059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:14.732917 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:14.733449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:14.733871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:15.041182 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:15.042195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:15.049116 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:15.051445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:15.052918 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:15.053861 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:15.055013 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:15.055635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:15.110250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:15.123120 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:15.127304 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:15.131411 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-291a02b6-32f0-4923-990e-eed09fb7b4f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.418644 Sep 09 23:03:15.132530 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 53/105] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:14 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:03:15.244524 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:15.253005 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-23336dd0-94bf-4c83-80c2-763f2c1c2ede tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.216502 Sep 09 23:03:15.253484 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 53/106] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:15 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:15.363729 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:15.364447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:15.376012 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:15.376789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:15.377503 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:15.378390 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:15.379176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:15.379722 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:15.536758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:15.545627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0d35a87-8223-40b0-8844-041bb5026c4d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1314 microversion: 2.1 time: 0.189892 Sep 09 23:03:15.546391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 54/107] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:15 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:15.736830 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:15.737737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:15.747322 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:15.753923 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:15.754382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:15.755271 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:15.756543 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:15.756971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:15.979516 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:15.987235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28ec2437-cb70-4e46-aedb-63ffa194b8d0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1515 microversion: 2.1 time: 0.256979 Sep 09 23:03:15.991608 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 54/108] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:15 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:16.012748 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:16.029008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:16.034954 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.035677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.036119 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.036857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.037454 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.038041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.067398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:16.103767 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lazy-loading 'flavor' on Instance uuid 424d37d5-0527-4e4c-8a5f-e2b37084c377 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:03:16.166444 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:16.167842 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:16.178064 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.179289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.180215 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.181347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.181993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.182496 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.260993 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-81d69315-a1cf-459e-917e-0c5f59906a78 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377/action" status: 200 len: 32 microversion: 2.1 time: 0.251704 Sep 09 23:03:16.263137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 55/109] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:03:16 2022] POST /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:03:16.274900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:16.276158 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:16.286225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.287168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.288562 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.290650 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.292940 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.293652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.343132 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:16.353949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:16.355443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:16.356871 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e90c24f-b0ac-4dff-8812-436b07aa1bd5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1407 microversion: 2.20 time: 0.197540 Sep 09 23:03:16.372272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 55/110] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:16 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:16.379359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:16.380982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:16.388319 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.389025 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.389599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.390469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.391191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.391808 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.488282 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:16.499620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e0fbf9f-e652-4458-a98a-9276be61bf7a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.229536 Sep 09 23:03:16.517158 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 56/111] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:16 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:16.549622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:16.559076 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac0aac9d-7554-4590-8a69-49e57ee85628 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.200123 Sep 09 23:03:16.560405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 56/112] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:16 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:16.585058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:16.585803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:16.591910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.592395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.592834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.593533 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:16.594049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:16.594450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:16.825632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:16.840040 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b3d636d-ba3c-41fd-a673-a136c22ccbcb tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1502 microversion: 2.1 time: 0.258700 Sep 09 23:03:16.841264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 57/113] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:16 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:17.382465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:17.383067 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:17.394189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:17.394670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:17.396513 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:17.397296 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:17.397761 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:17.398185 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:17.526164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:17.526637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:17.534764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:17.538618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:17.539251 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:17.540492 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:17.541030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:17.541385 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:17.993766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:17.994588 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:18.006615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:18.007727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f4d140e-0ee4-49ac-94a6-297b86963af8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.485742 Sep 09 23:03:18.008553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 58/114] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:17 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:18.012293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:18.013713 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:18.014429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:18.015943 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7564e20b-1a55-402f-a68d-518e16001705 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1599 microversion: 2.20 time: 0.638196 Sep 09 23:03:18.016918 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 57/115] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:03:17 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1599 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:03:18.039857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:18.040538 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:18.041310 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:18.042508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:18.043157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:18.043384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:18.044102 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:18.044215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:18.051328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:18.052094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:18.053384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:18.054309 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:18.054967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:18.055658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:18.214621 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-469f8a18-d5be-44bd-9b0d-d9fcafcb6eab tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.176568 Sep 09 23:03:18.215437 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 58/116] 10.222.0.17 () {60 vars in 1316 bytes} [Fri Sep 9 23:03:18 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:03:18.503259 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:18.510364 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb8efa25-7411-4f24-83ae-fa4e15433913"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:18.513617 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:18.518443 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54a109b6-1317-4db0-991c-d2f596706975 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.507951 Sep 09 23:03:18.519050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 59/117] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:18 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:18.526337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:18.527255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:18.527822 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:18.528734 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:18.529403 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:18.531213 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:19.030911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:19.031470 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:19.042803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:19.043313 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:19.046826 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:19.047890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:19.049840 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:19.051563 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:19.061626 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf9fb6ce-89f2-46a4-8ed7-e263aa1cb18d tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "POST /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555788 Sep 09 23:03:19.070099 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 59/118] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:03:18 2022] POST /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:19.423801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:19.444560 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1995b767-fb93-43d4-8d31-fe66bb6ccccf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.417635 Sep 09 23:03:19.446320 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 60/119] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:19 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:19.543898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:19.545630 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:19.558702 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:19.559194 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:19.559673 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:19.564982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:19.564982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:19.564982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:19.917199 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:19.926273 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42eb4509-2b4d-45be-9231-373e681cb9a0 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1367 microversion: 2.1 time: 0.387222 Sep 09 23:03:19.926868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 60/120] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:19 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:20.467779 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:20.468381 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:20.477442 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:20.477932 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:20.478362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:20.482916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:20.482916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:20.482916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:20.524891 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-79c173a8-30a5-40f0-8358-c6783bc578e5 req-6c47cedd-a954-47b8-baa4-abf62027d9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2052a904-5812-447c-b0ac-d3c9dc4321cb", "tag": "37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:20.547584 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-79c173a8-30a5-40f0-8358-c6783bc578e5 req-6c47cedd-a954-47b8-baa4-abf62027d9d0 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:20.548830 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-79c173a8-30a5-40f0-8358-c6783bc578e5 req-6c47cedd-a954-47b8-baa4-abf62027d9d0 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:20.551367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-79c173a8-30a5-40f0-8358-c6783bc578e5 req-6c47cedd-a954-47b8-baa4-abf62027d9d0 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:20.582020 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-79c173a8-30a5-40f0-8358-c6783bc578e5 req-6c47cedd-a954-47b8-baa4-abf62027d9d0 service nova] Creating event network-changed:37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba for instance 2052a904-5812-447c-b0ac-d3c9dc4321cb on hv-cinder-85221 Sep 09 23:03:20.590874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-79c173a8-30a5-40f0-8358-c6783bc578e5 req-6c47cedd-a954-47b8-baa4-abf62027d9d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068408 Sep 09 23:03:20.592555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 61/121] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:20.753987 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:20.768282 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f65be57-671f-4347-8430-d779f5ae6330 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.304434 Sep 09 23:03:20.781893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 61/122] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:20 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:20.949556 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:20.950481 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:20.964240 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:20.964738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:20.968584 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:20.969602 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:20.970246 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:20.971639 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:21.187573 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:21.200931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71fa5e8d-3a68-4fd2-885a-d3da2264ac10 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1558 microversion: 2.1 time: 0.253061 Sep 09 23:03:21.200931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 62/123] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:20 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1558 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:21.224565 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:21.226348 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:21.237394 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:21.238046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:21.238658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:21.240292 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:21.240889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:21.241508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:21.368080 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08c37b7d-7c5f-4518-ba68-81f7b54b2319 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149381 Sep 09 23:03:21.369934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 62/124] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 23:03:21 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:21.792961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:21.794172 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:21.804771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:21.806312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:21.807894 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:21.808606 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:21.811131 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:21.813829 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:21.855238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:22.428462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:22.448379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3a7e6c6-99a9-49be-8b62-3198143ca960 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.659291 Sep 09 23:03:22.452318 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 63/125] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:21 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:23.475940 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:23.477013 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:23.485223 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:23.485882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:23.486427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:23.487288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:23.487890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:23.488557 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:23.796730 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:23.809661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9fbe2637-7517-4216-9663-6ce09d3c1896 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.337552 Sep 09 23:03:23.812512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 63/126] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:23 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:23.936494 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-fe6e4a01-eae0-479d-b6e6-b1c0304ffae9 req-210bd4b0-d4d3-460f-b2f1-050cc3c63c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04df6bca-4a68-4c7c-a314-ab08a28dfec3", "tag": "a1982a7e-608a-4e41-ae98-2ee9fbdcdf4f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:23.952772 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fe6e4a01-eae0-479d-b6e6-b1c0304ffae9 req-210bd4b0-d4d3-460f-b2f1-050cc3c63c62 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:23.953412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fe6e4a01-eae0-479d-b6e6-b1c0304ffae9 req-210bd4b0-d4d3-460f-b2f1-050cc3c63c62 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:23.954195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fe6e4a01-eae0-479d-b6e6-b1c0304ffae9 req-210bd4b0-d4d3-460f-b2f1-050cc3c63c62 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:23.981214 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fe6e4a01-eae0-479d-b6e6-b1c0304ffae9 req-210bd4b0-d4d3-460f-b2f1-050cc3c63c62 service nova] Creating event network-changed:a1982a7e-608a-4e41-ae98-2ee9fbdcdf4f for instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 on hv-cinder-85221 Sep 09 23:03:24.007703 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-fe6e4a01-eae0-479d-b6e6-b1c0304ffae9 req-210bd4b0-d4d3-460f-b2f1-050cc3c63c62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073242 Sep 09 23:03:24.011159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 64/127] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:24.834759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:24.836018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:24.842850 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:24.843346 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:24.843952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:24.845543 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:24.846337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:24.846829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:25.256654 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:25.270957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a2466d5-444b-42a8-b9c8-4631964a67b4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.440424 Sep 09 23:03:25.275001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 64/128] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:24 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:26.301420 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:26.302663 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:26.313279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:26.313941 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:26.314453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:26.315238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:26.315754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:26.316531 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:26.521552 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:26.530255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6b4a8129-572c-4fde-9da8-3d5d8044a355 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.233867 Sep 09 23:03:26.538401 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 65/129] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:26 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:26.758821 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-855316779", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "networks": [{"uuid": "c9f00784-ff32-4a59-9d7d-8b6943f7e4e5"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:26.826608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] validate_networks() for [('c9f00784-ff32-4a59-9d7d-8b6943f7e4e5', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:03:27.283772 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:03:27.284526 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:03:27.285175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:03:27.285757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:03:27.286429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:03:27.296583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:27.297264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:27.297903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:27.298803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:27.299431 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:27.300053 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:27.317145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Getting quotas for project 70d39d21d2844c3599629db4abdc1600. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:03:27.321411 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Getting quotas for user cf0dc39479d1435f902e10cb6827f5e4 and project 70d39d21d2844c3599629db4abdc1600. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:03:27.334838 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:03:27.337332 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:03:27.421967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-017ab123-f1d1-4e51-bf8f-997659d66da4 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670540 Sep 09 23:03:27.423599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 65/130] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:03:27.434428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac8321bf-ec78-4e1b-b9e2-c30bc1f62e49 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:27.435676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac8321bf-ec78-4e1b-b9e2-c30bc1f62e49 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:27.520705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac8321bf-ec78-4e1b-b9e2-c30bc1f62e49 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:27.532026 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac8321bf-ec78-4e1b-b9e2-c30bc1f62e49 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1218 microversion: 2.1 time: 0.101208 Sep 09 23:03:27.549117 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 66/131] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:27 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:27.558230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:27.559124 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:27.572357 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:27.574726 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:27.575542 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:27.577534 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:27.579075 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:27.580132 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:27.841358 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:27.854028 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f739873-fabd-4cfa-bd12-b2dc99755b3a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.298484 Sep 09 23:03:27.870183 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 66/132] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:27 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:28.557341 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:28.559208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:28.575656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:28.577327 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:28.577999 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:28.580976 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:28.584510 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:28.585146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:28.680297 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:28.693662 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c25d2896-2da1-48db-849d-fca91eb4f916 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1270 microversion: 2.1 time: 0.139205 Sep 09 23:03:28.699650 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 67/133] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:28 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:28.852008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:28.852572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:28.860588 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:28.868283 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:28.869219 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:28.870226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:28.871115 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:28.872089 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:28.882441 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:28.883438 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:28.896590 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:28.897753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:28.898428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:28.899852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:28.900528 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:28.901169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:28.940389 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:03:29.080572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-826c688a-83ef-4f7c-bc4f-da2a0b09f721 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "DELETE /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 204 len: 0 microversion: 2.1 time: 0.232151 Sep 09 23:03:29.082267 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 67/134] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:03:28 2022] DELETE /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:03:29.093145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:29.094412 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:29.106598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:29.107083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:29.107721 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:29.108724 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:29.109300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:29.110025 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:29.122155 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:29.134408 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c37a5a6-fcdd-433b-80e3-c518562a186c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.258246 Sep 09 23:03:29.135093 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 68/135] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:28 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:29.298816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:29.309869 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7a56ed0-4afc-4155-95c5-a0f5c22c977a tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1554 microversion: 2.1 time: 0.221124 Sep 09 23:03:29.310910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 68/136] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:29 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:29.722160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:29.722777 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:29.729863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:29.730354 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:29.730792 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:29.731580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:29.731967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:29.732389 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:29.808748 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:29.824566 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5977c3b8-d2f9-40a7-8bc1-41dc7b45e362 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1278 microversion: 2.1 time: 0.106395 Sep 09 23:03:29.826403 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 69/137] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:29 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1278 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:30.167416 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:30.169142 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:30.184839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:30.186362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:30.187049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:30.187901 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:30.188232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:30.188663 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:30.196169 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:30.328883 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:30.339354 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-32759890-243f-40da-bb9a-a5355d2cd1f2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.181786 Sep 09 23:03:30.340182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 69/138] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:30 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:30.341023 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:30.341879 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:30.349402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:30.349902 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:30.350337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:30.351087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:30.351595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:30.352129 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:30.486594 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:30.495878 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63206439-0357-47ac-b487-3cfc9069084b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1554 microversion: 2.1 time: 0.161351 Sep 09 23:03:30.496592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 70/139] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:30 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:30.849478 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:30.850263 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:30.862114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:30.863283 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:30.863773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:30.864873 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:30.867245 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:30.870909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:30.955097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:30.964216 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1753c23b-7a74-40a5-9498-81e1418ea837 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1278 microversion: 2.1 time: 0.119747 Sep 09 23:03:30.965192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 70/140] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:30 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1278 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:31.363458 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:31.364238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:31.374430 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:31.374430 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:31.374430 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:31.374430 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:31.374791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:31.374791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:31.512051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:31.519776 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab198d56-5a70-4724-adbe-88a92db70a90 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.160272 Sep 09 23:03:31.520331 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 71/141] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:31 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:31.520927 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:31.521766 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:31.527616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:31.528097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:31.528527 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:31.529206 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:31.529651 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:31.530069 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:31.773469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:31.781555 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f22e454f-d825-471d-893d-99633e01b031 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1554 microversion: 2.1 time: 0.264426 Sep 09 23:03:31.782122 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 71/142] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:31 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:31.991568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:31.992241 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:31.997739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=89 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:31.999964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:32.000461 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:32.000901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:32.001599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:32.002053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:32.002478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:32.078309 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:32.089609 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9cd0b80c-6fe7-4aaa-9ba0-96eaa1fe3c7d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1276 microversion: 2.1 time: 0.101858 Sep 09 23:03:32.090284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 72/143] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:31 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:32.544324 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:32.546289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:32.561373 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:32.564358 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:32.564809 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:32.565997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:32.566184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:32.566717 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:32.806340 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:32.806971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:32.813801 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:32.814285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:32.814713 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:32.815398 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:32.815873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:32.816509 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:32.850816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:32.860409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa69408a-53c7-46fa-afcc-addf8bc91ae9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.321102 Sep 09 23:03:32.861495 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 72/144] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:32 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:32.973444 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:32.984973 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-16e56e13-3fa3-4fff-a34f-ab539e660b3b tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1554 microversion: 2.1 time: 0.182378 Sep 09 23:03:32.985764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 73/145] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:32 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:33.072274 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f6389008-e373-4822-b1be-6b4a46d35254 req-a578d953-7cd7-47c0-9d13-e3b18a92f8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675371e9-d81e-4019-a0ea-bf2c10fc0e81", "name": "network-vif-deleted", "tag": "cf2d7648-76c0-400a-9e40-8ebf9db74ec0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:33.087451 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6389008-e373-4822-b1be-6b4a46d35254 req-a578d953-7cd7-47c0-9d13-e3b18a92f8fc service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:33.087988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6389008-e373-4822-b1be-6b4a46d35254 req-a578d953-7cd7-47c0-9d13-e3b18a92f8fc service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:33.088448 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6389008-e373-4822-b1be-6b4a46d35254 req-a578d953-7cd7-47c0-9d13-e3b18a92f8fc service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:33.100853 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f6389008-e373-4822-b1be-6b4a46d35254 req-a578d953-7cd7-47c0-9d13-e3b18a92f8fc service nova] Creating event network-vif-deleted:cf2d7648-76c0-400a-9e40-8ebf9db74ec0 for instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 on hv-cinder-85221 Sep 09 23:03:33.114183 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:33.115093 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:33.118732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f6389008-e373-4822-b1be-6b4a46d35254 req-a578d953-7cd7-47c0-9d13-e3b18a92f8fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043735 Sep 09 23:03:33.121022 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 73/146] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:33.124753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:33.125317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:33.125829 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:33.127046 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:33.127845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:33.128508 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:33.271127 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:33.279005 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e85464f5-0f44-4b94-8b48-822f59042598 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.170069 Sep 09 23:03:33.280018 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 74/147] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:33 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:33.887302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:33.888248 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:33.896750 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:33.897238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:33.897666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:33.898352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:33.898796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:33.899239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:34.009444 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:34.010064 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:34.016093 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:34.016573 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:34.017040 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:34.017729 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:34.018181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:34.018637 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:34.069363 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:34.077199 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f249bca3-5924-4dda-850e-258d0723c948 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.194052 Sep 09 23:03:34.077765 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 74/148] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:33 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:34.096338 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:34.105515 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-834de103-9e0f-4c60-b610-ec961bd1a78c tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1512 microversion: 2.1 time: 0.100701 Sep 09 23:03:34.106085 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 75/149] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:34 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:34.303983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:34.304628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:34.311476 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:34.311941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:34.312378 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:34.313071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:34.313558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:34.313983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:34.472272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:34.480674 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4885357e-4791-4226-9e2d-a86080ef27dd tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.181972 Sep 09 23:03:34.481249 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 75/150] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:34 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:35.103914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:35.104534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:35.110815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:35.111292 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:35.111745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:35.112441 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:35.112945 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:35.113367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:35.129755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:35.131007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:35.137349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:35.140315 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:35.141405 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:35.142065 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:35.143162 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:35.144054 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:35.144562 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:35.217356 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:35.227079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea19b452-8abc-49a5-b250-088d33ced240 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1345 microversion: 2.1 time: 0.101059 Sep 09 23:03:35.227690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 76/151] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:35 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:35.232056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e872c5a8-2b6b-451e-9fad-275e755811fb req-cad1407d-f250-407b-ba98-332fc7f70431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee743f1-88ac-4570-90da-c9f8a2edc5e2", "tag": "b3d517ce-0d04-47e7-aba8-fca9bd3c5569"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:35.242220 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e872c5a8-2b6b-451e-9fad-275e755811fb req-cad1407d-f250-407b-ba98-332fc7f70431 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:35.243007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e872c5a8-2b6b-451e-9fad-275e755811fb req-cad1407d-f250-407b-ba98-332fc7f70431 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:35.243369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e872c5a8-2b6b-451e-9fad-275e755811fb req-cad1407d-f250-407b-ba98-332fc7f70431 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:35.255998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e872c5a8-2b6b-451e-9fad-275e755811fb req-cad1407d-f250-407b-ba98-332fc7f70431 service nova] Creating event network-changed:b3d517ce-0d04-47e7-aba8-fca9bd3c5569 for instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 on hv-cinder-85221 Sep 09 23:03:35.260890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e872c5a8-2b6b-451e-9fad-275e755811fb req-cad1407d-f250-407b-ba98-332fc7f70431 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031954 Sep 09 23:03:35.261835 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 77/152] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:35.279354 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:35.287723 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50bb3adc-0d17-436b-9c58-e5f32867e9b5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.189329 Sep 09 23:03:35.288304 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 76/153] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:35 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:35.507094 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:35.507999 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:35.514034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:35.514510 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:35.514936 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:35.515675 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:35.516124 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:35.516861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:35.672494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:35.680793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce9d5dfa-c216-40c5-891c-9cc7e9037442 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.178785 Sep 09 23:03:35.681352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 78/154] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:35 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:36.251429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:36.252753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:36.265865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:36.266511 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:36.267181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:36.268003 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:36.272996 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:36.273635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:36.311277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:36.311916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:36.318563 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:36.319040 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:36.319519 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:36.320278 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:36.320732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:36.321149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:36.349449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:36.360830 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de916ad6-78bb-49fb-80a5-41f283f77ddd tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1345 microversion: 2.1 time: 0.114457 Sep 09 23:03:36.377422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 77/155] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:36 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:36.555430 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:36.568532 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2445800-3004-4f97-a7c4-9bfcda6ce9af tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.261640 Sep 09 23:03:36.569799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 79/156] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:36 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:36.706950 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:36.707711 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:36.714820 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:36.715679 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:36.716215 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:36.717007 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:36.717562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:36.718082 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:36.868121 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:36.878461 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a58b4170-824d-4ca9-8da8-8fe09519090b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.177329 Sep 09 23:03:36.879195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 78/157] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:36 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:37.402982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:37.403624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:37.407211 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:37.407875 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:37.414280 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:37.415232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:37.416102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:37.417200 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:37.417823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:37.418250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:37.462042 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:37.462541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:37.462977 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:37.463434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lazy-loading 'fault' on Instance uuid 675371e9-d81e-4019-a0ea-bf2c10fc0e81 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:03:37.596482 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:37.597076 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:37.599292 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:37.605272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:37.605766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:37.606207 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:37.606913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:37.607373 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:37.607874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:37.667178 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a554beedec4915b6ad1066823c8d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e966946c8e5a4e71803e8e37971160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:37.679822 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-47ed03e3-7860-46bc-8966-f38649e2ffbe tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 200 len: 1350 microversion: 2.1 time: 0.281086 Sep 09 23:03:37.680419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 80/158] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:37 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 1350 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:37.756277 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:37.765767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1830c6b5-c2c6-4583-a7e8-30a6d56ac0c6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.172652 Sep 09 23:03:37.771293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 79/159] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:37 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:37.903005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:37.903880 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:37.910929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:37.911460 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:37.911926 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:37.912794 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:37.913320 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:37.913812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:38.050156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:38.058668 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a43053e-4497-4269-82e0-659b35e3a8d8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.161076 Sep 09 23:03:38.059232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 81/160] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:37 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:38.704464 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:38.705161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:38.711580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:38.712047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:38.712478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:38.713162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:38.713613 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:38.714032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:38.727739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] HTTP exception thrown: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Request method failure captured: Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 HTTP/1.1 Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YJy_a1nJ0GqN19PPPfpyvh3GWwYahOKg1Eehw2zafqa975McaahmC309jacwOdkjziUiKd7i1PRGTGWHl3b_hTlib0QS414R9Fma9H1pSwmuw2HpE0ukL7gF6G1CTvqDZZAasS42P13x3YRQa8r7RKxOGS7y2Md1MLVddBIHZS8qM Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: e966946c8e5a4e71803e8e37971160e1 Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:03:38.745170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e966946c8e5a4e71803e8e37971160e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: e966946c8e5a4e71803e8e37971160e1 Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1477591776-project Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 56a554beedec4915b6ad1066823c8d4e Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1477591776-project Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.746668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '675371e9-d81e-4019-a0ea-bf2c10fc0e81'} Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:03:38.747625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.749335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.751094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Returning 404 to user: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:03:38.751094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0735acce-1c8c-4593-b42f-a936296250a3 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 404 len: 111 microversion: 2.1 time: 0.046355 Sep 09 23:03:38.751094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 80/161] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:38 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:03:38.789478 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:38.804935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:38.811570 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:38.812182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:38.812730 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:38.813669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:38.814125 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:38.814580 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:38.863017 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:38.865850 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:38.872559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:38.873047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:38.873477 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:38.874162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:38.874622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:38.875046 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:38.888100 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] HTTP exception thrown: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Request method failure captured: Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81/os-volume_attachments HTTP/1.1 Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YJy_a1nJ0GqN19PPPfpyvh3GWwYahOKg1Eehw2zafqa975McaahmC309jacwOdkjziUiKd7i1PRGTGWHl3b_hTlib0QS414R9Fma9H1pSwmuw2HpE0ukL7gF6G1CTvqDZZAasS42P13x3YRQa8r7RKxOGS7y2Md1MLVddBIHZS8qM Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: e966946c8e5a4e71803e8e37971160e1 Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:03:38.889821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e966946c8e5a4e71803e8e37971160e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: e966946c8e5a4e71803e8e37971160e1 Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1477591776-project Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 56a554beedec4915b6ad1066823c8d4e Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1477591776-project Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.891353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'server_id': '675371e9-d81e-4019-a0ea-bf2c10fc0e81'} Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:03:38.892170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:38.893451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:38.894802 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Returning 404 to user: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:03:38.894802 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c90c51e2-9374-4f7f-90b3-777b053bbf0e tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032556 Sep 09 23:03:38.894802 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 81/162] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:03:38 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:03:38.951639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:38.959659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df7b6824-9e47-494f-8135-1e6ad4c24813 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.174294 Sep 09 23:03:38.960230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 82/163] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:38 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:39.084625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:39.085268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:39.091579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:39.092251 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:39.092702 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:39.093645 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:39.094068 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:39.094491 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:39.228402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:39.235966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e64ce62b-692f-4e40-8064-2919352eac79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.155289 Sep 09 23:03:39.236519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 82/164] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:39 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:39.982820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:39.983449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:39.990097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:39.990579 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:39.991009 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:39.991728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:39.992182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:39.992601 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:40.131527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:40.134662 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:40.142571 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:40.143746 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:40.144348 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:40.145706 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:40.149974 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:40.151690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:40.164418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:40.173493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:40.174867 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] HTTP exception thrown: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Request method failure captured: Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 HTTP/1.1 Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YJy_a1nJ0GqN19PPPfpyvh3GWwYahOKg1Eehw2zafqa975McaahmC309jacwOdkjziUiKd7i1PRGTGWHl3b_hTlib0QS414R9Fma9H1pSwmuw2HpE0ukL7gF6G1CTvqDZZAasS42P13x3YRQa8r7RKxOGS7y2Md1MLVddBIHZS8qM Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: e966946c8e5a4e71803e8e37971160e1 Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:03:40.177794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e966946c8e5a4e71803e8e37971160e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: e966946c8e5a4e71803e8e37971160e1 Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1477591776-project Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 56a554beedec4915b6ad1066823c8d4e Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1477591776-project Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.179130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '675371e9-d81e-4019-a0ea-bf2c10fc0e81'} Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:03:40.180146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.193445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.194815 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-950dd5a5-85a2-4763-894d-251787006d35 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.201035 Sep 09 23:03:40.194815 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 83/165] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:39 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:40.194964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Returning 404 to user: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:03:40.194964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b984e55-7ae9-4fed-b186-243b73f05189 tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "DELETE /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 404 len: 111 microversion: 2.1 time: 0.056967 Sep 09 23:03:40.194964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 83/166] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:03:40 2022] DELETE /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:03:40.195839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:40.196102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] [instance: 675371e9-d81e-4019-a0ea-bf2c10fc0e81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:40.202641 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:40.203137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:40.203601 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:40.204497 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:40.204971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:40.205395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:40.219889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] HTTP exception thrown: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Request method failure captured: Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 HTTP/1.1 Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YJy_a1nJ0GqN19PPPfpyvh3GWwYahOKg1Eehw2zafqa975McaahmC309jacwOdkjziUiKd7i1PRGTGWHl3b_hTlib0QS414R9Fma9H1pSwmuw2HpE0ukL7gF6G1CTvqDZZAasS42P13x3YRQa8r7RKxOGS7y2Md1MLVddBIHZS8qM Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: e966946c8e5a4e71803e8e37971160e1 Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:03:40.224856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e966946c8e5a4e71803e8e37971160e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e966946c8e5a4e71803e8e37971160e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: e966946c8e5a4e71803e8e37971160e1 Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-1477591776 Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-1477591776-project Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 56a554beedec4915b6ad1066823c8d4e Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-1477591776-project Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.226233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '675371e9-d81e-4019-a0ea-bf2c10fc0e81'} Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:03:40.226885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. Sep 09 23:03:40.227983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:40.228923 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] Returning 404 to user: Instance 675371e9-d81e-4019-a0ea-bf2c10fc0e81 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:03:40.228923 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6ba7d818-3d96-4d38-bf1a-d504681438dc tempest-DeleteServersTestJSON-1477591776 tempest-DeleteServersTestJSON-1477591776-project] 10.222.0.17 "GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81" status: 404 len: 111 microversion: 2.1 time: 0.036896 Sep 09 23:03:40.228923 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 84/167] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:40 2022] GET /compute/v2.1/servers/675371e9-d81e-4019-a0ea-bf2c10fc0e81 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:03:40.259358 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:40.260692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:40.267776 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:40.268385 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:40.268950 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:40.269796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:40.277332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:40.277798 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:40.485426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:40.500121 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54d4a2b0-b405-44df-bfe7-0d4e012c31a6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.244970 Sep 09 23:03:40.501364 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 84/168] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:40 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:41.207228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:41.208898 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:41.215277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:41.215904 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:41.216401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:41.217468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:41.218344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:41.219089 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:41.432223 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:41.441079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b092724f-1206-4776-b824-8a7077402c8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.237638 Sep 09 23:03:41.455552 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 85/169] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:41 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:41.525938 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:41.526552 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:41.533981 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:41.534474 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:41.534909 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:41.535643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:41.536265 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:41.536694 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:41.715538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:41.720882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c7c100e8-11ba-47dd-8d93-53ce71b3d62b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.201038 Sep 09 23:03:41.736261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 85/170] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:41 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:42.432053 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3b78e778-3735-4f68-9dea-bc529ae82d72 req-4c678bc9-e6b7-41bc-9aa1-c2d38124ce69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee743f1-88ac-4570-90da-c9f8a2edc5e2", "name": "network-vif-plugged", "status": "completed", "tag": "b3d517ce-0d04-47e7-aba8-fca9bd3c5569"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:42.447414 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b78e778-3735-4f68-9dea-bc529ae82d72 req-4c678bc9-e6b7-41bc-9aa1-c2d38124ce69 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:42.448246 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b78e778-3735-4f68-9dea-bc529ae82d72 req-4c678bc9-e6b7-41bc-9aa1-c2d38124ce69 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:42.449493 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b78e778-3735-4f68-9dea-bc529ae82d72 req-4c678bc9-e6b7-41bc-9aa1-c2d38124ce69 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:42.466082 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:42.466695 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:42.466980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3b78e778-3735-4f68-9dea-bc529ae82d72 req-4c678bc9-e6b7-41bc-9aa1-c2d38124ce69 service nova] Creating event network-vif-plugged:b3d517ce-0d04-47e7-aba8-fca9bd3c5569 for instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 on hv-cinder-85221 Sep 09 23:03:42.473387 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3b78e778-3735-4f68-9dea-bc529ae82d72 req-4c678bc9-e6b7-41bc-9aa1-c2d38124ce69 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047876 Sep 09 23:03:42.474716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:42.475820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 86/171] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:42.481241 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:42.481748 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:42.482493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:42.483094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:42.483826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:42.667183 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:42.676761 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98eeec79-6eb4-40b8-9225-947d6da86a47 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.214102 Sep 09 23:03:42.677492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 86/172] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:42 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:42.745121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:42.745823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:42.752044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:42.752552 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:42.752986 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:42.753682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:42.754131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:42.754550 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:43.028140 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:43.039046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a4c94e2-5b62-4765-b468-4a6c33b59e0b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.298298 Sep 09 23:03:43.051692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 87/173] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:42 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:43.700987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:43.701684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:43.708294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:43.708894 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:43.709352 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:43.710055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:43.710516 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:43.711031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:43.860670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:43.875811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d73fbac-2c73-4eff-9ac1-55db15e807ca tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.178484 Sep 09 23:03:43.892861 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 87/174] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:43 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:44.068479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:44.069861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:44.084954 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:44.088231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:44.089817 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:44.091734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:44.092384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:44.095624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:44.105153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:03:44.351524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:44.359441 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23603c0a-fa70-4d5a-9a4c-d0bccaef6bf6 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1318 microversion: 2.1 time: 0.301111 Sep 09 23:03:44.360057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 88/175] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:44 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:44.900739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:44.901348 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:44.907784 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:44.908261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:44.908684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:44.909380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:44.909826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:44.910515 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:45.285488 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:45.316461 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-498746dd-3f79-40eb-b0e3-26bd9a499b24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.419807 Sep 09 23:03:45.318742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 88/176] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:44 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:45.382871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:45.383324 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:45.389398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:45.390184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:45.390811 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:45.391941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:45.392747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:45.393125 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:45.566612 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:45.575768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-69e3cf74-b792-432b-b565-d86d2cebba5e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1507 microversion: 2.1 time: 0.197690 Sep 09 23:03:45.576334 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 89/177] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:45 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:46.046301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea97dfe9-90af-4169-9f69-d92a83a081ef tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Action: 'create', calling method: .version_select at 0x7fcecf6cfd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-521647352"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:46.356175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:46.356969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:46.364058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:46.364867 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:46.365402 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:46.366312 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:46.366832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:46.367450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:46.380531 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea97dfe9-90af-4169-9f69-d92a83a081ef tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.473160 Sep 09 23:03:46.388214 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 89/178] 10.222.0.17 () {60 vars in 1155 bytes} [Fri Sep 9 23:03:45 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 483 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 23:03:46.393075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2aff008d-41c2-4930-936d-9cf3ddd61cd6 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf7c9a60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:46.468445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2aff008d-41c2-4930-936d-9cf3ddd61cd6 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70" status: 200 len: 344 microversion: 2.1 time: 0.079077 Sep 09 23:03:46.469015 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 90/179] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:03:46 2022] GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:46.565570 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:46.573612 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4c536773-0de5-4d67-8911-5d2e81980bee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.234769 Sep 09 23:03:46.574180 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 90/180] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:46 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:47.488188 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-591d352b-9f25-4d10-b798-756e09c6d867 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf51aa60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:47.538716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-591d352b-9f25-4d10-b798-756e09c6d867 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70" status: 200 len: 345 microversion: 2.1 time: 0.059006 Sep 09 23:03:47.539281 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 91/181] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:03:47 2022] GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:47.552263 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9e88215-6311-4de3-9523-a1130f517c54 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Action: 'create', calling method: .version_select at 0x7fcecf5f8820>, body: {"snapshot": {"volume_id": "b88292cd-982d-457a-9c19-21d77296ef70", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-626868475"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:03:47.598285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:47.600329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:47.610066 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:47.610826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:47.615175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:47.616674 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:47.617152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:47.617585 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:47.759734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9e88215-6311-4de3-9523-a1130f517c54 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.205859 Sep 09 23:03:47.766222 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 91/182] 10.222.0.17 () {60 vars in 1162 bytes} [Fri Sep 9 23:03:47 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:47.774281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a47a174-f30b-4d8e-8aad-34c639f2342c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf4a8160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:47.813337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a47a174-f30b-4d8e-8aad-34c639f2342c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 200 len: 286 microversion: 2.1 time: 0.045722 Sep 09 23:03:47.814005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 92/183] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:03:47 2022] GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:47.817010 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:47.825680 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-582a9dda-3a8c-4045-81d1-68becb58ca0e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.232515 Sep 09 23:03:47.826299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 92/184] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:47 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:47.826433 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b64045c-263a-4d1c-9510-0bdea98b388e tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf4a80d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:47.869277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b64045c-263a-4d1c-9510-0bdea98b388e tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.046733 Sep 09 23:03:47.869845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 93/185] 10.222.0.17 () {58 vars in 1140 bytes} [Fri Sep 9 23:03:47 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:47.882388 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aedaac58-afb1-441d-8c2d-e4c2cf6d95f5 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fced022c430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:47.912755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aedaac58-afb1-441d-8c2d-e4c2cf6d95f5 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 200 len: 286 microversion: 2.1 time: 0.034607 Sep 09 23:03:47.913317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 93/186] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:03:47 2022] GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:48.850649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:48.851251 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:48.858483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:48.859090 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:48.859562 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:48.860619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:48.861418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:48.862186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:48.933602 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ac61279-3943-4f27-92b4-3e29939a1658 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf589310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:48.973448 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ac61279-3943-4f27-92b4-3e29939a1658 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 200 len: 286 microversion: 2.1 time: 0.051014 Sep 09 23:03:48.974011 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 94/187] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:03:48 2022] GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:49.009637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:49.018469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f828f061-7935-47a2-a094-623bafc47c44 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.172976 Sep 09 23:03:49.019032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 94/188] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:48 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:49.987326 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07892cee-bac6-47a5-a40f-e46b16e16e76 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf661430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:50.026399 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07892cee-bac6-47a5-a40f-e46b16e16e76 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 200 len: 286 microversion: 2.1 time: 0.043904 Sep 09 23:03:50.027478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 95/189] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:03:49 2022] GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:50.043755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:50.044383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:50.050579 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:50.051070 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:50.051877 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:50.052577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:50.053349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:50.053785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:50.199774 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:50.209818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a3e1c96-f668-443f-a5ae-6ab55a04292c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.170716 Sep 09 23:03:50.210832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 95/190] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:50 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:03:51.040284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e225578-cda4-4a16-9db9-960ecde982fd tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf589310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:51.071598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e225578-cda4-4a16-9db9-960ecde982fd tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 200 len: 286 microversion: 2.1 time: 0.035611 Sep 09 23:03:51.072173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 96/191] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:03:51 2022] GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:51.233475 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:51.234091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:51.244398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:51.245201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:51.245844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:51.246622 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:51.247172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:51.247761 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:51.417129 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:51.425697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-053f7f7b-fde2-4433-8e9a-30936f991c3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.196218 Sep 09 23:03:51.427708 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 96/192] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:51 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:52.085951 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1268562d-afcd-43f7-afc6-43db4d70c935 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fced022c430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:52.141872 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1268562d-afcd-43f7-afc6-43db4d70c935 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 200 len: 287 microversion: 2.1 time: 0.061838 Sep 09 23:03:52.143242 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 97/193] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:03:52 2022] GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:52.154998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa450f93-3599-4815-b73d-a2d364a2a8ab tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf5ae8b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:52.251640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa450f93-3599-4815-b73d-a2d364a2a8ab tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 202 len: 0 microversion: 2.1 time: 0.100309 Sep 09 23:03:52.262252 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74c1ebf3-860e-4795-b538-5e1693a2202c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf7c99d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:52.264427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 97/194] 10.222.0.17 () {58 vars in 1254 bytes} [Fri Sep 9 23:03:52 2022] DELETE /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:03:52.302427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74c1ebf3-860e-4795-b538-5e1693a2202c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 200 len: 286 microversion: 2.1 time: 0.044958 Sep 09 23:03:52.308380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 98/195] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:03:52 2022] GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:03:52.450181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:52.451296 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:52.459121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:52.459969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:52.460585 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:52.461470 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:52.462087 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:52.462803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:52.684619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:52.695265 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63c8b015-2820-43f2-9f04-b1650b0f075b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.248867 Sep 09 23:03:52.696733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 98/196] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:52 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:53.317119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ef527c1-7008-4908-ae0e-482efd819024 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf7c9700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:53.352586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1ef527c1-7008-4908-ae0e-482efd819024 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] HTTP exception thrown: Snapshot fb5a3581-a493-4802-9274-81fb5a77a5d9 could not be found. Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ef527c1-7008-4908-ae0e-482efd819024 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Request method failure captured: Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 HTTP/1.1 Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8ZRjQf_lx-5GWw64tRdsAqLurlqfAJGFB1XxqojwduOkKw7ktC72x3sWFlc7i6h93svR1_puvgnEF0sz9r01rXXR6nhJ2aDI-ZEKjyDYhFHf6bCRBtcRS-iYNmWmtz3zKZUJYnYo8WHt8iPimH_hWWld0i8tt3To82PDsBSJMWsUhQ Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: abb14f47b1654c99ae6989f276bc629c Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:03:53.356690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_abb14f47b1654c99ae6989f276bc629c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: abb14f47b1654c99ae6989f276bc629c Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotsTestJSON-590377232-project Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 1926f8ca5b9e4cb1a721a71510e52404 Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-590377232-project Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Snapshot fb5a3581-a493-4802-9274-81fb5a77a5d9 could not be found. Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'fb5a3581-a493-4802-9274-81fb5a77a5d9'} Sep 09 23:03:53.358122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fb5a3581-a493-4802-9274-81fb5a77a5d9 could not be found. (HTTP 404) (Request-ID: req-590e5d4c-aec8-49f9-84fd-9fcb4d301498) Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:53.359031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:03:53.361059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fb5a3581-a493-4802-9274-81fb5a77a5d9 could not be found. Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 23:03:53.362286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fb5a3581-a493-4802-9274-81fb5a77a5d9 could not be found. Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fb5a3581-a493-4802-9274-81fb5a77a5d9 could not be found. Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ef527c1-7008-4908-ae0e-482efd819024 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Returning 404 to user: Snapshot fb5a3581-a493-4802-9274-81fb5a77a5d9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ef527c1-7008-4908-ae0e-482efd819024 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9" status: 404 len: 111 microversion: 2.1 time: 0.046391 Sep 09 23:03:53.365397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 99/197] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:03:53 2022] GET /compute/v2.1/os-snapshots/fb5a3581-a493-4802-9274-81fb5a77a5d9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:03:53.370571 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f514abd7-c884-4430-a1d9-7d296b330346 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf5f85e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:53.466637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f514abd7-c884-4430-a1d9-7d296b330346 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70" status: 202 len: 0 microversion: 2.1 time: 0.101619 Sep 09 23:03:53.467210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 99/198] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:03:53 2022] DELETE /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:03:53.477950 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d90762e2-c1ce-49c6-bee3-98a103e747b7 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf567040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:53.546002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d90762e2-c1ce-49c6-bee3-98a103e747b7 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70" status: 200 len: 344 microversion: 2.1 time: 0.073830 Sep 09 23:03:53.546661 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 100/199] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:03:53 2022] GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:03:53.727608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:53.727608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:53.733176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:53.733749 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:53.734729 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:53.735577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:53.736099 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:53.736589 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:53.924331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:53.934454 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-905f691a-99c2-4796-b9af-95ccae129011 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.218776 Sep 09 23:03:53.935245 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 100/200] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:53 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:54.561709 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8145be71-420c-414e-a71b-74dd3d2e507c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf7c9550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:54.595726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-8145be71-420c-414e-a71b-74dd3d2e507c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] HTTP exception thrown: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8145be71-420c-414e-a71b-74dd3d2e507c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Request method failure captured: Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 HTTP/1.1 Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8ZRjQf_lx-5GWw64tRdsAqLurlqfAJGFB1XxqojwduOkKw7ktC72x3sWFlc7i6h93svR1_puvgnEF0sz9r01rXXR6nhJ2aDI-ZEKjyDYhFHf6bCRBtcRS-iYNmWmtz3zKZUJYnYo8WHt8iPimH_hWWld0i8tt3To82PDsBSJMWsUhQ Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: abb14f47b1654c99ae6989f276bc629c Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:03:54.598676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_abb14f47b1654c99ae6989f276bc629c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: abb14f47b1654c99ae6989f276bc629c Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotsTestJSON-590377232-project Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 1926f8ca5b9e4cb1a721a71510e52404 Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-590377232-project Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'b88292cd-982d-457a-9c19-21d77296ef70'} Sep 09 23:03:54.599993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. (HTTP 404) (Request-ID: req-b21f4685-981c-45b3-8e57-00805ac3ddfd) Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.600785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:03:54.601910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 23:03:54.602933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8145be71-420c-414e-a71b-74dd3d2e507c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Returning 404 to user: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:03:54.604008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8145be71-420c-414e-a71b-74dd3d2e507c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70" status: 404 len: 109 microversion: 2.1 time: 0.042942 Sep 09 23:03:54.610010 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 101/201] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:03:54 2022] GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:03:54.614885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-743a66da-e63c-4199-a844-0c5fc5d9ea7c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf5d81f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:54.653757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-743a66da-e63c-4199-a844-0c5fc5d9ea7c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] HTTP exception thrown: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-743a66da-e63c-4199-a844-0c5fc5d9ea7c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Request method failure captured: Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 HTTP/1.1 Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8ZRjQf_lx-5GWw64tRdsAqLurlqfAJGFB1XxqojwduOkKw7ktC72x3sWFlc7i6h93svR1_puvgnEF0sz9r01rXXR6nhJ2aDI-ZEKjyDYhFHf6bCRBtcRS-iYNmWmtz3zKZUJYnYo8WHt8iPimH_hWWld0i8tt3To82PDsBSJMWsUhQ Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: abb14f47b1654c99ae6989f276bc629c Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:03:54.655690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_abb14f47b1654c99ae6989f276bc629c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: abb14f47b1654c99ae6989f276bc629c Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotsTestJSON-590377232-project Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 1926f8ca5b9e4cb1a721a71510e52404 Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-590377232-project Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'b88292cd-982d-457a-9c19-21d77296ef70'} Sep 09 23:03:54.657021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. (HTTP 404) (Request-ID: req-ffd835ea-2809-48a5-9690-d23d5740d847) Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.657911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:03:54.661593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 23:03:54.662606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-743a66da-e63c-4199-a844-0c5fc5d9ea7c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Returning 404 to user: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-743a66da-e63c-4199-a844-0c5fc5d9ea7c tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70" status: 404 len: 109 microversion: 2.1 time: 0.046690 Sep 09 23:03:54.663636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 101/202] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:03:54 2022] DELETE /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:03:54.666469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f702cfed-c575-4cad-9377-127277b0a554 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Calling method '.version_select at 0x7fcecf567dc0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:54.703078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f702cfed-c575-4cad-9377-127277b0a554 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] HTTP exception thrown: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f702cfed-c575-4cad-9377-127277b0a554 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Request method failure captured: Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 HTTP/1.1 Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8ZRjQf_lx-5GWw64tRdsAqLurlqfAJGFB1XxqojwduOkKw7ktC72x3sWFlc7i6h93svR1_puvgnEF0sz9r01rXXR6nhJ2aDI-ZEKjyDYhFHf6bCRBtcRS-iYNmWmtz3zKZUJYnYo8WHt8iPimH_hWWld0i8tt3To82PDsBSJMWsUhQ Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: abb14f47b1654c99ae6989f276bc629c Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:03:54.705449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_abb14f47b1654c99ae6989f276bc629c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abb14f47b1654c99ae6989f276bc629c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: abb14f47b1654c99ae6989f276bc629c Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-590377232 Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotsTestJSON-590377232-project Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 1926f8ca5b9e4cb1a721a71510e52404 Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-590377232-project Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'b88292cd-982d-457a-9c19-21d77296ef70'} Sep 09 23:03:54.706913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. (HTTP 404) (Request-ID: req-7cb50e6c-45f9-4da7-94c7-9645095e1dad) Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.707862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:03:54.708998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 23:03:54.716041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. Sep 09 23:03:54.717289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:03:54.720230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f702cfed-c575-4cad-9377-127277b0a554 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] Returning 404 to user: Volume b88292cd-982d-457a-9c19-21d77296ef70 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:03:54.720658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f702cfed-c575-4cad-9377-127277b0a554 tempest-VolumesSnapshotsTestJSON-590377232 tempest-VolumesSnapshotsTestJSON-590377232-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70" status: 404 len: 109 microversion: 2.1 time: 0.057457 Sep 09 23:03:54.727960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 102/203] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:03:54 2022] GET /compute/v2.1/os-volumes/b88292cd-982d-457a-9c19-21d77296ef70 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:03:54.963727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:54.964446 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:54.977208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:54.977896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:54.978512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:54.983009 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:54.983680 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:54.984293 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:55.333423 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:55.347899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75841ac8-b975-493e-be7a-0becb87943f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.386857 Sep 09 23:03:55.349007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 102/204] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:54 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:56.378242 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:56.380124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:56.387838 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:56.388533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:56.389332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:56.391269 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:56.391923 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:56.392635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:56.565153 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:56.574257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca26e680-a7d3-4683-bb58-f5c48516cd9b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.203537 Sep 09 23:03:56.575384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 103/205] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:56 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:57.597657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:57.598209 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:57.611226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:57.612693 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:57.616141 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:57.617170 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:57.618506 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:57.619742 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:57.908394 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:57.935619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca636447-e9ad-4c43-8590-eb6112cf2b6c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.341714 Sep 09 23:03:57.940593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 103/206] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:57 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:03:58.959976 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:03:58.960609 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:03:58.968699 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:58.969181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:58.975190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:58.976035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:03:58.976772 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:03:58.977393 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:03:59.482797 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:03:59.491846 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6426b71-b14d-467d-8cd9-4c4a4400b51a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.536451 Sep 09 23:03:59.492972 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 104/207] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:03:58 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:00.506607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7919f21d-b44b-48d5-9e46-f7711285a63e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Action: 'create', calling method: .version_select at 0x7fcecf4a8670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-89000540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjhpwY1OglgNZrvJLV2FKlANd/DTcfw8yG2YVXQ3RrM/joPDbk1Ut8FRPO/fsL2k9LsFZNp6DJ22vxTDYGxeOznwoJS147OnpnaNYFujs+jWyqariZDTZMknDUYwkAhTg=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:00.517108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:00.518523 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:00.523411 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-7919f21d-b44b-48d5-9e46-f7711285a63e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Getting quotas for project 82213ebf52f24af49758dd17e5e1d129. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:04:00.526073 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:00.526902 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:00.527573 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:00.528668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:00.529503 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:00.530126 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:00.532447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-7919f21d-b44b-48d5-9e46-f7711285a63e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Getting quotas for user 3cbefab6dddb45c381158126d203f66b and project 82213ebf52f24af49758dd17e5e1d129. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:04:00.588785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7919f21d-b44b-48d5-9e46-f7711285a63e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.418844 Sep 09 23:04:00.590069 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 104/208] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:04:00 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:04:00.704377 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:00.713236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-12cbae49-da49-4be4-8244-4c929ba3b924 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.200219 Sep 09 23:04:00.714213 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 105/209] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:00 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:01.738568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:01.739221 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:01.755324 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:01.758436 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:01.759217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:01.760186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:01.760860 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:01.761745 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:01.934875 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:01.943742 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2775d896-6d89-480c-9739-578a47ccca3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1521 microversion: 2.1 time: 0.209389 Sep 09 23:04:01.944310 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 105/210] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:01 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:02.966571 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:02.967210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:02.969536 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=42 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:02.974766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:02.975250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:02.975787 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:02.976475 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:02.976930 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:02.977355 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:03.106805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:03.114429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-95da0956-7dfa-4242-80b5-03acaa98e786 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1501 microversion: 2.1 time: 0.151787 Sep 09 23:04:03.115002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 106/211] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:02 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:03.137021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:03.137632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:03.145710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:03.146534 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:03.147165 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:03.147886 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:03.148338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:03.148754 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:03.307257 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:03.316725 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-575b2ecf-a2ea-4687-a221-95e630bb7593 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1516 microversion: 2.1 time: 0.183260 Sep 09 23:04:03.333201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 106/212] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:03 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:06.896813 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:06.899130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:06.905602 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:06.906088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:06.906526 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:06.907218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:06.907734 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:06.908358 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:06.937669 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lazy-loading 'flavor' on Instance uuid 645207f3-4aff-46ce-8998-aae640598f3b {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:04:07.056083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a84d56c9-30de-4d16-a381-d04e3ef147d6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b/action" status: 200 len: 32 microversion: 2.1 time: 0.163664 Sep 09 23:04:07.056861 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 107/213] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:04:06 2022] POST /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:04:07.067053 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:07.067718 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:07.070003 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:07.075294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:07.076120 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:07.076790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:07.077571 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:07.078102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:07.078625 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:07.338331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:07.362910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa9c0cda-6bc0-4c03-bc04-7a14d668bad1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.299654 Sep 09 23:04:07.364788 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 107/214] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:07 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:08.388399 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:08.389112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:08.396295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:08.396771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:08.397199 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:08.397875 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:08.398322 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:08.398770 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:08.530488 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:08.538352 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2463be40-590d-4c84-91c6-9b9f756901e6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.154755 Sep 09 23:04:08.538940 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 108/215] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:08 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:09.562176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:09.562776 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:09.568657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:09.569129 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:09.569557 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:09.570232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:09.570678 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:09.571098 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:09.709869 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:09.720420 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d94f5d1-6470-4ce7-8c16-644e77132d62 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.162288 Sep 09 23:04:09.721023 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 108/216] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:09 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:10.743629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:10.744633 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:10.751099 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:10.751625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:10.752064 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:10.752757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:10.753541 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:10.754047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:10.759961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:10.976473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:10.985220 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b4c5c06-c3b7-4ce4-8903-b9de63ba4d30 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.245368 Sep 09 23:04:10.985783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 109/217] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:10 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:12.009551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:12.010238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:12.012094 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:12.018306 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:12.018797 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:12.019236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:12.020624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:12.021103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:12.021513 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:12.150068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:12.157784 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8cd14665-ec4a-47d2-95ba-0c56abdc3862 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.152171 Sep 09 23:04:12.158351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 109/218] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:12 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:13.183118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:13.183949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:13.190736 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:13.191226 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:13.191690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:13.192388 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:13.192841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:13.193263 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:13.331443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:13.340322 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a4c9a23-3237-433c-986e-21edb3a4d016 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.161438 Sep 09 23:04:13.341362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 110/219] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:13 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:14.366769 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:14.367386 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:14.375626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:14.376150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:14.376584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:14.377278 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:14.377729 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:14.378152 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:14.381502 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=89 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:14.511248 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:14.519196 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-736e8560-1801-4219-bc38-c6a5a61a53a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.157101 Sep 09 23:04:14.519803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 110/220] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:14 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:15.070671 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:15.071204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:15.077573 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:15.078049 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:15.078481 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:15.079157 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:15.079653 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:15.080073 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:15.103255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2014a5dd-4b42-4904-923f-1a6cdbbae944 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/ips" status: 200 len: 152 microversion: 2.20 time: 0.036950 Sep 09 23:04:15.103845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 111/221] 10.222.0.17 () {60 vars in 1289 bytes} [Fri Sep 9 23:04:15 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:04:15.542126 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:15.542782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:15.548691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:15.549225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:15.549660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:15.550346 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:15.550799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:15.551270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:15.677134 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:15.684691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96db7996-c36f-490e-8b59-abb155dcaf4b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.146498 Sep 09 23:04:15.685254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 111/222] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:15 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:16.708081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:16.708618 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:16.715434 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:16.715945 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:16.716371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:16.717057 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:16.717625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:16.718042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:16.852384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:16.861112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7acf0a40-446a-4084-ac1f-03348ef326a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.156909 Sep 09 23:04:16.861698 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 112/223] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:16 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:17.884479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:17.885086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:17.891147 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:17.891672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:17.892105 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:17.892786 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:17.893345 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:17.893670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:18.053822 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:18.062999 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c34299c-785b-46fa-8e7c-924ed21d60df tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.182324 Sep 09 23:04:18.063588 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 112/224] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:17 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:18.244016 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:18.244570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:18.251621 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:18.252047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:18.252501 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:18.253186 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:18.253637 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:18.254060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:18.281704 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lazy-loading 'flavor' on Instance uuid 2052a904-5812-447c-b0ac-d3c9dc4321cb {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:04:18.522412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-caf32f6d-2c61-465d-9bb5-909c62324354 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/action" status: 202 len: 0 microversion: 2.20 time: 0.281757 Sep 09 23:04:18.523393 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 113/225] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 9 23:04:18 2022] POST /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:04:18.534738 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:18.536154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:18.544554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:18.545144 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:18.545877 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:18.547631 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:18.548159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:18.549271 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:18.703665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:18.712491 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:18.714202 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:18.715912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d903d948-9b37-490b-b708-23e51dc70178 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.186835 Sep 09 23:04:18.717157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 113/226] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:18 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:19.087093 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:19.087736 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:19.093899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:19.094384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:19.094819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:19.095527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:19.095981 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:19.096404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:19.228025 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:19.235920 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37447ee0-51b9-437f-baae-052c7fd15aa3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.153327 Sep 09 23:04:19.236486 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 114/227] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:19 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:19.742164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:19.742772 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:19.749538 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:19.750029 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:19.750469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:19.751159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:19.751639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:19.752067 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:19.887989 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:19.896614 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:19.898057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:19.899212 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33c056fc-71f5-4de7-ae75-935fab1ff9a9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.160943 Sep 09 23:04:19.899808 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 114/228] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:19 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:20.259844 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:20.260444 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:20.266762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:20.267237 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:20.267712 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:20.268393 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:20.268840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:20.269260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:20.402652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:20.410297 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8539125f-d2fa-43d2-9013-24e522605c24 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.154950 Sep 09 23:04:20.410856 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 115/229] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:20 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:20.925651 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:20.926232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:20.933150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:20.933635 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:20.934068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:20.934779 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:20.935232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:20.935688 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:21.068642 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:21.076619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:21.078057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:21.079214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0ff6d2e-e231-4d6c-a645-7289f129e0f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.157527 Sep 09 23:04:21.079812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 115/230] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:20 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:21.434050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:21.434664 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:21.441377 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:21.441867 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:21.442299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:21.442992 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:21.443449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:21.443904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:21.575630 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:21.583190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a13f4b0c-b5ea-4cf2-ad57-1b5ecb475a22 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.153054 Sep 09 23:04:21.584415 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 116/231] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:21 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:22.104599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:22.105255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:22.111266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:22.111773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:22.112204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:22.112877 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:22.113322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:22.113742 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:22.241033 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:22.248938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:22.250360 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:22.251530 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb9f2f00-79c1-49ed-84e2-f5695af29e75 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.150786 Sep 09 23:04:22.252083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 116/232] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:22 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:22.606685 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:22.607321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:22.613567 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:22.614039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:22.614465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:22.615141 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:22.615612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:22.616026 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:22.877678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:22.885998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f9089ec5-71e2-4fb3-add0-02dfbdf033e0 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.283043 Sep 09 23:04:22.886578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 117/233] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:22 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:23.277036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:23.277628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:23.283527 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:23.284013 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:23.284446 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:23.285129 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:23.285589 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:23.286012 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:23.418855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:23.427081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:23.429051 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:23.430196 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e0b9b57-c03b-445f-9da9-9bc6834ecfc1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.157117 Sep 09 23:04:23.430749 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 117/234] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:23 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:23.909592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:23.910603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:23.917384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:23.917864 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:23.918304 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:23.918993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:23.919445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:23.919896 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:24.047836 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:24.056337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1bf831e1-858b-4c28-afd3-2ce16867e54f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.150606 Sep 09 23:04:24.056882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 118/235] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:23 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:24.455502 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:24.456231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:24.462351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:24.462835 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:24.463255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:24.469509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:24.469509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:24.469509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:24.606192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:24.616240 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:24.618784 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:24.620525 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce6f15ec-5b56-4bd4-9a68-14bc3f3d96c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.168796 Sep 09 23:04:24.621480 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 118/236] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:24 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:25.077977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:25.078580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:25.084803 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:25.085302 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:25.085712 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:25.086389 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:25.086835 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:25.087250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:25.215445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:25.230776 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83cc599d-ae52-4140-a6a1-e4cbc9c63ff9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.156479 Sep 09 23:04:25.231360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 119/237] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:25 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:25.646957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:25.647669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:25.653484 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:25.653969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:25.654404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:25.655090 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:25.655570 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:25.655997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:25.796201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:25.804777 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:25.806228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:25.807381 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73818cd4-a76d-4561-bef2-c540017dfa3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.164831 Sep 09 23:04:25.807991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 119/238] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:25 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:26.253978 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:26.254592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:26.261476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:26.261959 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:26.262454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:26.263137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:26.263625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:26.264079 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:26.402114 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:26.409873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-60ef4de1-c3c0-4985-861e-e31d3f2b5043 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.159725 Sep 09 23:04:26.410435 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 120/239] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:26 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:26.832058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:26.832662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:26.838577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:26.839059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:26.839511 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:26.840191 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:26.840640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:26.841083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:26.973743 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:26.982153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:26.983641 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:26.984795 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-220a5341-9b09-4773-9204-f7d4932be5b9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.156551 Sep 09 23:04:26.985353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 120/240] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:26 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:27.433003 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:27.433615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:27.439987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:27.440408 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:27.440840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:27.441523 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:27.441977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:27.442397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:27.571831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:27.579389 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dfe93bcf-82ca-4f6b-bc63-8d606f9fbda8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.150288 Sep 09 23:04:27.579984 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 121/241] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:27 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:28.011006 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:28.011998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:28.020486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:28.021194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:28.021831 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:28.022847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:28.023552 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:28.024190 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:28.158160 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:28.166715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:28.168242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:28.169383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a926055-38f1-4850-b476-d94e807d5d4b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.163095 Sep 09 23:04:28.169938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 121/242] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:28 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:28.602903 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:28.603553 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:28.610061 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:28.610547 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:28.610989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:28.611711 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:28.612172 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:28.612599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:28.751285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:28.759661 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-991003cb-f763-4cc9-b6e5-d51454ada9d2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.161252 Sep 09 23:04:28.760267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 122/243] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:28 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:28.896541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34ddf2ab-36fb-468e-b762-dd5612f16f73", "device": "/dev/sdb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:28.900135 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:28.905987 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:28.906467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:28.906902 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:28.907611 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:28.908068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:28.908490 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:29.196748 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:29.197590 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:29.204527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:29.205018 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:29.205460 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:29.206327 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:29.206954 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:29.207556 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:29.228527 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f77d414-6f83-427c-91fc-2a3fd1e0794d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "POST /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335585 Sep 09 23:04:29.229762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 122/244] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:04:28 2022] POST /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:04:29.387385 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:29.395516 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:29.396991 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:29.398137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5768cc77-8e5f-4e80-bac6-08d4607c5b70 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.206256 Sep 09 23:04:29.398840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 123/245] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:29 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:29.409465 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:29.410725 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:29.417169 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:29.417648 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:29.418083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:29.418762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:29.419210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:29.419725 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:29.445269 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bee0c823-1aee-4ed0-961f-75427cc5eeb7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/ips" status: 200 len: 150 microversion: 2.1 time: 0.040511 Sep 09 23:04:29.445824 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 123/246] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:04:29 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:04:29.787018 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:29.788207 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:29.815798 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:29.816434 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:29.816977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:29.817790 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:29.818579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:29.819388 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:29.825294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:30.041426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:30.049285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f53160fb-36e1-4048-b322-0c7010b7585a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.269592 Sep 09 23:04:30.049854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 124/247] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:29 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:30.423805 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:30.424839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:30.431998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:30.436960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:30.437427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:30.438143 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:30.438606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:30.439036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:30.574171 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:30.587986 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:30.589391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:30.591360 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83b7f8dc-991d-46e7-9f41-2dc4538d1752 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.171532 Sep 09 23:04:30.592763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 124/248] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:30 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:31.073703 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:31.074418 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:31.080874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:31.081359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:31.081795 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:31.082482 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:31.082943 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:31.083371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:31.222432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:31.231051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d862024f-1689-49ef-afc8-78d15184ae8d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.161922 Sep 09 23:04:31.231660 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 125/249] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:31 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:31.616422 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:31.617023 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:31.623907 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:31.624380 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:31.624810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:31.625484 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:31.625934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:31.626349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:31.760056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:31.762331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:31.769223 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:31.770662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:31.771834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5c1ee30-2f3b-435a-a5a0-8fe72d65fff5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.159260 Sep 09 23:04:31.772390 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 125/250] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:31 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:32.257861 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:32.258470 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:32.264885 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:32.265361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:32.265793 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:32.266474 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:32.266927 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:32.267344 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:32.398946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:32.407023 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-096314fb-1df2-47eb-869d-6e96c8d9fb52 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.153023 Sep 09 23:04:32.407604 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 126/251] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:32 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:32.796736 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:32.797332 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:32.804885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:32.805393 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:32.805822 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:32.806505 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:32.806947 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:32.807362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:33.098874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:33.109494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:33.110996 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:33.112247 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78562d56-ef43-4f54-a420-ecfd10b692c8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.319439 Sep 09 23:04:33.112803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 126/252] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:32 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:33.431012 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:33.431777 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:33.434058 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=42 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:33.440165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:33.440657 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:33.441099 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:33.441827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:33.442289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:33.442721 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:33.592537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:33.600448 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ddf431de-4012-46db-ae0e-afb62f86f725 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.173937 Sep 09 23:04:33.601022 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 127/253] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:33 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:34.034058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "313dcb36-a664-4af7-8b18-4f788b317d39"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:34.036467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:34.045250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:34.045728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:34.046155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:34.046846 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:34.047296 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:34.047745 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:34.137526 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:34.138133 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:34.144053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:34.144533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:34.144966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:34.145652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:34.146103 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:34.146525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:34.271803 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:34.280436 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:34.281877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:34.283033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e6ade47-3f22-4a65-a967-f137a008602f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.149894 Sep 09 23:04:34.283611 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 128/254] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:34 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:34.624327 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:34.625055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:34.631929 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:34.632419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:34.632846 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:34.634184 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:34.634654 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:34.635075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:34.774738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:34.782350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a60ec9ce-fb88-4e38-a14e-a905012d683c tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.161893 Sep 09 23:04:34.782912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 129/255] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:34 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:35.308094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:35.308698 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:35.314719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:35.315199 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:35.315679 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:35.316367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:35.316820 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:35.317242 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:35.445360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:35.453269 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:35.454703 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:35.455895 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dfafb028-d3af-434a-94b4-64dc55820306 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.151672 Sep 09 23:04:35.456447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 130/256] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:35 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:35.805877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:35.806507 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:35.812899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:35.813371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:35.813803 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:35.814493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:35.814946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:35.815372 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:35.940610 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:35.948724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dac7381e-88bb-4179-bd0c-d17244948536 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.146966 Sep 09 23:04:35.949294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 131/257] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:35 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:36.481581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:36.482492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:36.489736 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:36.490469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:36.490652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:36.491349 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:36.491835 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:36.492260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:36.631969 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:36.641930 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:36.643407 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:36.644849 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61a57936-d315-43bc-bcf9-7654fee6950d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.167474 Sep 09 23:04:36.660261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 132/258] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:36 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:36.756682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2e9d4db-8a04-4a56-b191-549894102f8b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.726431 Sep 09 23:04:36.757578 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 127/259] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:04:34 2022] POST /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments => generated 194 bytes in 2728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:04:36.972143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:36.972823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:36.979636 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:36.980113 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:36.980537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:36.981216 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:36.981665 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:36.982077 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:37.114290 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:37.122362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f23600be-8ba8-4982-a106-54a23f1f9842 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.153974 Sep 09 23:04:37.123294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 133/260] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:36 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:37.671943 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:37.672587 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:37.674605 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=42 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:37.680887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:37.681370 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:37.681802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:37.682487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:37.682970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:37.683394 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:37.818670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:37.827435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:37.828900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:37.830047 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7fa842bc-9505-44a9-8a26-997d9de93042 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.163020 Sep 09 23:04:37.830609 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 128/261] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:37 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:38.147685 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:38.148296 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:38.154574 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:38.155061 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:38.155518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:38.156198 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:38.156653 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:38.157075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:38.303744 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:38.314854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd83b574-8f79-4764-b3b3-93399825350a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.168507 Sep 09 23:04:38.314854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 134/262] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:38 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:38.855371 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:38.855933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:38.862722 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:38.863219 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:38.863787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:38.864509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:38.865160 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:38.865529 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:39.002533 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:39.011231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:39.012710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:39.013866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc434d58-f8ec-477e-b899-6491d1664af0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.162668 Sep 09 23:04:39.014418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 129/263] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:38 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:39.336985 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:39.337593 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:39.345126 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:39.345607 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:39.346032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:39.346782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:39.347229 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:39.347694 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:39.482500 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:39.490192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-305ef014-643e-42a7-909b-39b208ac1173 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.157875 Sep 09 23:04:39.490752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 135/264] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:39 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:40.042647 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:40.043417 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:40.050408 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:40.051015 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:40.051526 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:40.052540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:40.053058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:40.053544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:40.196404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:40.204957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:40.206399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:40.207578 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18ca71f0-0f36-4a47-985d-053d21fb6274 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.169778 Sep 09 23:04:40.208140 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 130/265] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:40 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:40.513259 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:40.514419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:40.520837 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:40.521315 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:40.521745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:40.522428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:40.522878 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:40.523293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:40.660214 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:40.668390 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06047d87-66c2-4d34-935a-451206ee7022 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.158994 Sep 09 23:04:40.668947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 136/266] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:40 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:41.232633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:41.233325 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:41.240531 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:41.240941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:41.241400 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:41.242275 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:41.243618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:41.244048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:41.392403 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:41.400362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:41.401812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:41.402962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1da45349-efff-425f-b306-88811f389c79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1745 microversion: 2.20 time: 0.174717 Sep 09 23:04:41.403544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 131/267] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:41 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:41.691496 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:41.692115 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:41.698495 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:41.698968 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:41.699397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:41.700147 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:41.700600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:41.701021 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:41.834053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:41.841782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e030e192-38bb-4e51-af22-ad5d37188ab3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.154183 Sep 09 23:04:41.842353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 137/268] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:41 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:42.428210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:42.428817 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:42.435396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:42.435907 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:42.436344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:42.437030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:42.437478 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:42.437894 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:42.586001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:42.596572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:42.598066 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:42.599232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ad62ca1-831b-4359-bdbd-0ecf61d39383 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1745 microversion: 2.20 time: 0.175174 Sep 09 23:04:42.599838 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 132/269] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:42 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:42.865754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:42.866293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:42.873170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:42.873643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:42.874073 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:42.874750 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:42.875198 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:42.875651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.004359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:43.012599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68a7e0d8-25ff-49e2-8564-a98f6d322360 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1502 microversion: 2.1 time: 0.150734 Sep 09 23:04:43.013169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 138/270] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:42 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:43.034899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34b59f26-3bfd-4812-88c6-1593aa6389bc"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:43.037338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:43.043345 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:43.043865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:43.044306 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.045027 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:43.045487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:43.045923 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.068899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] HTTP exception thrown: Cannot 'attach_volume' instance 645207f3-4aff-46ce-8998-aae640598f3b while it is in vm_state rescued Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Request method failure captured: Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b/os-volume_attachments HTTP/1.1 Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 74 Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YMi6ZzbmB27jSPQ1U4kf4RUObmjASl_OhA8mz0SjKjl4Vh6y6FTEgtBU3YAMjW_CZOA_TsB615F-OUgidE-l386CGo5SneVJLwHUryaBNIS55zAz5QWLzFIlEU36DefwbLD3JHo265zJDYosp2C6vCQJqVnQhrM-94DZktV4JCnn0 Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:04:43.070574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d688ef3e358c4822823707982fe4f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d688ef3e358c4822823707982fe4f654", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: e24e6fb4c69d48f7b2972b53fb8ea4a1 Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {"volumeAttachment": {"volumeId": "34b59f26-3bfd-4812-88c6-1593aa6389bc"}} Sep 09 23:04:43.072691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Cannot 'attach_volume' instance 645207f3-4aff-46ce-8998-aae640598f3b while it is in vm_state rescued Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'server_id': '645207f3-4aff-46ce-8998-aae640598f3b', 'body': {'volumeAttachment': {'volumeId': '34b59f26-3bfd-4812-88c6-1593aa6389bc'}}} Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 645207f3-4aff-46ce-8998-aae640598f3b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:04:43.073728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 645207f3-4aff-46ce-8998-aae640598f3b while it is in vm_state rescued Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:04:43.075213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:04:43.076537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:04:43.076537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:04:43.076537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 645207f3-4aff-46ce-8998-aae640598f3b while it is in vm_state rescued Sep 09 23:04:43.076537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:04:43.076537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Returning 409 to user: Cannot 'attach_volume' instance 645207f3-4aff-46ce-8998-aae640598f3b while it is in vm_state rescued {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:04:43.076537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c5c070a-8108-4a75-9131-5cb1bf01274e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041882 Sep 09 23:04:43.076537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 133/271] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:04:43 2022] POST /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 23:04:43.083892 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:43.084442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:43.090621 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:43.091107 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:43.091576 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.092347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:43.093222 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:43.094005 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.154030 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:43.164048 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-abf5fcd3-89de-4375-9d84-7ffa5054b74d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b/action" status: 202 len: 0 microversion: 2.1 time: 0.085045 Sep 09 23:04:43.165337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 139/272] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:04:43 2022] POST /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:04:43.173426 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:43.174041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:43.186575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:43.186575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:43.186575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.186575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:43.187187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:43.187187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.315419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:43.322997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d87526fb-d924-493a-ac8f-2fa297f467d3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.153599 Sep 09 23:04:43.323572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 134/273] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:43 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:43.624886 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:43.625625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:43.632204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:43.632695 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:43.633400 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.633839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:43.634295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:43.634720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:43.765387 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:43.773367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:43.775306 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:43.776487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eee98a98-0706-4f55-869c-06cc306ae259 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1745 microversion: 2.20 time: 0.155765 Sep 09 23:04:43.777047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 140/274] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:43 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:44.346027 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:44.346027 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:44.354316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:44.354806 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:44.355238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:44.355969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:44.356428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:44.356854 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:44.487108 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:44.494681 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-446fa31d-cf25-49d5-9b06-d7a5b01b104f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.152847 Sep 09 23:04:44.495250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 135/275] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:44 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:44.802148 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:44.802764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:44.809119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:44.809602 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:44.810037 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:44.810724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:44.811206 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:44.811669 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:44.940928 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:44.949572 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:44.951031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:44.952221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55e250df-f20d-4b7d-8bc9-6f497b9269c4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1745 microversion: 2.20 time: 0.154288 Sep 09 23:04:44.952771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 141/276] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:44 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:45.517467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:45.518077 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:45.525005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:45.525487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:45.525920 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:45.526607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:45.527062 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:45.527517 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:45.653474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:45.661028 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9f73fdf-3fde-4bbe-ad57-8932de521562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.147497 Sep 09 23:04:45.661590 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 136/277] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:45 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:45.977655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:45.978211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:45.984605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:45.985079 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:45.985525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:45.986183 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:45.986629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:45.987043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:46.112501 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:46.120912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:46.122347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:46.123519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b8ef284b-85c6-4e4f-8484-027f7a0c73a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1745 microversion: 2.20 time: 0.149870 Sep 09 23:04:46.124069 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 142/278] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:45 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:46.327149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-190c36e5-023a-43c8-9573-bddf180842c4 req-3ed1d82e-5b17-4ed2-9ee3-296d2e663746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2052a904-5812-447c-b0ac-d3c9dc4321cb", "name": "network-vif-plugged", "status": "completed", "tag": "37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:46.337941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-190c36e5-023a-43c8-9573-bddf180842c4 req-3ed1d82e-5b17-4ed2-9ee3-296d2e663746 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:46.338572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-190c36e5-023a-43c8-9573-bddf180842c4 req-3ed1d82e-5b17-4ed2-9ee3-296d2e663746 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:46.339058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-190c36e5-023a-43c8-9573-bddf180842c4 req-3ed1d82e-5b17-4ed2-9ee3-296d2e663746 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:46.353060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-190c36e5-023a-43c8-9573-bddf180842c4 req-3ed1d82e-5b17-4ed2-9ee3-296d2e663746 service nova] Creating event network-vif-plugged:37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba for instance 2052a904-5812-447c-b0ac-d3c9dc4321cb on hv-cinder-85221 Sep 09 23:04:46.358282 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-190c36e5-023a-43c8-9573-bddf180842c4 req-3ed1d82e-5b17-4ed2-9ee3-296d2e663746 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034901 Sep 09 23:04:46.363754 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 137/279] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:04:46.686317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:46.686958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:46.692823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:46.693302 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:46.693729 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:46.694414 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:46.694865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:46.695289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:46.837949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:46.856023 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-adbb4e3a-75ce-469c-b461-52a4d01e7db1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.173613 Sep 09 23:04:46.857077 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 143/280] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:46 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:47.150631 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:47.151327 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:47.157268 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:47.157746 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:47.158176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:47.158855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:47.159308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:47.159758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:47.298723 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:47.307127 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:47.308603 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:47.309762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1261c749-7fef-4f42-87fe-0fbb66ff79c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1745 microversion: 2.20 time: 0.163922 Sep 09 23:04:47.310319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 138/281] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:47 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:47.881042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:47.881845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:47.888742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:47.889233 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:47.889718 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:47.890376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:47.890841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:47.891308 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:48.032289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:48.041417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6b8b307-2aef-4c0d-8291-764fdceae39d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.164873 Sep 09 23:04:48.042075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 144/282] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:47 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:48.334199 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:48.334811 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:48.343036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:48.343705 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:48.344753 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:48.345750 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:48.346565 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:48.347081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:48.512621 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:48.528231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:48.529607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:48.530922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1fad8b0e-55f8-4385-963f-1096386a99f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.200595 Sep 09 23:04:48.531806 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 139/283] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:48 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:49.066804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:49.068108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:49.074981 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:49.075474 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:49.076058 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:49.077004 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:49.077628 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:49.078217 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:49.233951 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:49.245123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ea73d2c-cdc6-48db-a856-ee58c95d41ac tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.183303 Sep 09 23:04:49.247621 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 145/284] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:49 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:49.557095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:49.557698 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:49.564550 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:49.565033 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:49.565467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:49.566165 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:49.566792 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:49.567216 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:49.768355 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:49.777475 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:49.779204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:49.780624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2985b94f-af70-40be-a0c6-a16f7c9d7646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.227916 Sep 09 23:04:49.781197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 140/285] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:49 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:50.246483 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1374262262", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89000540", "security_groups": [{"name": "tempest-secgroup-smoke-2135557599"}], "block_device_mapping_v2": [{"uuid": "24601197-44aa-4886-a5fd-a8d2b6821906", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9445547a-ea9c-4c43-a619-716b862ad991"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:50.274257 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:50.275736 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:50.283798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:50.284920 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:50.286074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:50.287376 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:50.288730 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:50.291594 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:50.522578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] validate_networks() for [('9445547a-ea9c-4c43-a619-716b862ad991', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:04:50.572676 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:50.581112 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9cfd4b71-2af3-4616-8e8c-b0a9b4ad681e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.313928 Sep 09 23:04:50.582048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 141/286] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:50 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:50.806860 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:50.807796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:50.813900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:50.814854 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:50.815506 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:50.816417 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:50.817060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:50.817670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:50.822180 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:04:51.072847 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:04:51.073673 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:04:51.073769 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:04:51.074525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:04:51.074946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:04:51.084750 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:51.085831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:51.086804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:51.087577 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:51.088044 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:51.088473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:51.093682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:51.107965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:51.108233 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Getting quotas for project 82213ebf52f24af49758dd17e5e1d129. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:04:51.110799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:51.112193 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Getting quotas for user 3cbefab6dddb45c381158126d203f66b and project 82213ebf52f24af49758dd17e5e1d129. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:04:51.112773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-489c2e16-65bb-4ba4-a3f5-45207e47bcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.310666 Sep 09 23:04:51.113848 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 142/287] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:50 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:51.212728 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:04:51.215358 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24601197-44aa-4886-a5fd-a8d2b6821906',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:04:51.422329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-544d3759-8970-430a-b1c1-514b697b2502 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.180223 Sep 09 23:04:51.424135 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 146/288] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:04:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:04:51.436123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a931b86b-1d0c-49e6-9f70-eb6bef908419 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:51.437151 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a931b86b-1d0c-49e6-9f70-eb6bef908419 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:51.539657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a931b86b-1d0c-49e6-9f70-eb6bef908419 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:51.548053 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a931b86b-1d0c-49e6-9f70-eb6bef908419 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1093 microversion: 2.1 time: 0.116480 Sep 09 23:04:51.549304 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 143/289] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:51 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1093 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:04:51.606368 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:51.606982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:51.613842 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:51.614662 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:51.615826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:51.617145 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:51.618132 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:51.619191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:51.801141 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:51.813593 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d729e77-d42b-4ea0-905f-6ab67d19858f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.211005 Sep 09 23:04:51.814183 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 147/290] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:51 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:52.139266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:52.140874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:52.156153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:52.165144 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:52.178083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:52.178928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:52.182663 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:52.183361 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:52.399479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:52.411514 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:52.413483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:52.415480 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f7d379c-3f6e-408f-9ae9-fc66bc75417f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.280771 Sep 09 23:04:52.434342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 144/291] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:52 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:52.574189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:52.576782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:52.586972 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:52.587816 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:52.588330 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:52.589165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:52.589833 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:52.590273 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:52.667460 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:52.679565 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa2cb540-03dc-4512-b844-4d747ee4a53b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1135 microversion: 2.1 time: 0.109062 Sep 09 23:04:52.698580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 148/292] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:52 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1135 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:52.842618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:52.843236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:52.849485 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:52.850200 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:52.850856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:52.851576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:52.853032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:52.853654 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:53.054449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:53.063230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-15fb4450-f3db-491b-9cce-dc12a6a959e9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1510 microversion: 2.1 time: 0.225159 Sep 09 23:04:53.078608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 145/293] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:52 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:53.442166 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:53.442786 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:53.450163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:53.451089 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:53.451567 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:53.452568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:53.453181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:53.453599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:53.644756 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:53.654071 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:53.655729 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:53.660248 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8614a1bf-053c-4136-8dc6-cc736f5ea553 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.222272 Sep 09 23:04:53.661442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 149/294] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:53 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:53.709163 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:53.709762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:53.717921 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:53.718681 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:53.719273 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:53.720314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:53.720916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:53.721670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:53.813927 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:53.822281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36d5801f-fe45-4ab2-914d-8e28d0056f57 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1191 microversion: 2.1 time: 0.116978 Sep 09 23:04:53.841672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 146/295] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:53 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1191 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:54.088812 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:54.090222 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:54.096491 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:54.100544 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:54.104603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:54.105541 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:54.106006 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:54.106899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:54.268270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:54.276835 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7647d53d-02e5-4e15-b181-5611d58e1ba5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1516 microversion: 2.1 time: 0.192218 Sep 09 23:04:54.294227 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 150/296] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:54 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:54.724910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:54.727054 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:54.769824 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:54.772988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:54.773738 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:54.778769 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:54.781078 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:54.781788 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:54.848642 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:54.851409 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:54.865022 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:54.865914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:54.866360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:54.867078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:54.868245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:54.868678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:54.967313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:54.978629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0bc48276-587a-43a3-b53e-a8044218549f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1191 microversion: 2.1 time: 0.136904 Sep 09 23:04:54.980094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 151/297] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:54 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1191 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:54.985946 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:54.997589 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:54.999151 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:55.000359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4202e641-ad91-4db1-b248-172b02c9a15a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.308081 Sep 09 23:04:55.000905 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 147/298] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:54 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:56.003963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:56.004533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:56.010984 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:56.011578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:56.012208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:56.012904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:56.013559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:56.013988 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:56.026906 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:56.028330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:56.040541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:56.041292 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:56.044159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:56.045173 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:56.045786 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:56.047623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:56.083059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:56.093423 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5f0a5228-a165-4f92-896d-5a192308de51 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1191 microversion: 2.1 time: 0.091619 Sep 09 23:04:56.108502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 152/299] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:55 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1191 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:56.233292 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:56.243516 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:56.244980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:56.246291 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d4172aba-4a8f-4e2f-a829-694646a744ee tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.224242 Sep 09 23:04:56.246856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 148/300] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:56 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:57.119947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:57.122088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:57.128453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:57.129520 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:57.130123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:57.130992 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:57.131797 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:57.132375 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:57.206895 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:57.216076 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54b9689f-7b32-4d98-baef-c3b0779ca872 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1209 microversion: 2.1 time: 0.101781 Sep 09 23:04:57.233258 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 153/301] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:57 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:57.271118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:57.272146 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:57.288242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:57.288741 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:57.289235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:57.289955 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:57.290408 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:57.290827 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:57.509712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:57.518036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:57.519479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:57.520870 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d60d01ae-b750-42a7-88d8-4e5bc49d87dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.253883 Sep 09 23:04:57.539636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 149/302] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:57 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:04:58.021422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d658874-ab48-4a32-b713-83c5a75184a7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'create', calling method: .version_select at 0x7fcecf4e79d0>, body: {"keypair": {"name": "tempest-keypair-585194700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRx/W1e5InOv07IVMxP9V1HA5sV1kqvVieY0Pn3TiMLIo9tguPmb8Y5RpsseyjKSki2Xpi5FCzDV345b6zngsIIn1Yi1yGEybp+mJghTs0tfvZerQQC/VhWuapmNK5rFA=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:58.067722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-0d658874-ab48-4a32-b713-83c5a75184a7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Getting quotas for project d688ef3e358c4822823707982fe4f654. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:04:58.074145 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-0d658874-ab48-4a32-b713-83c5a75184a7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Getting quotas for user e24e6fb4c69d48f7b2972b53fb8ea4a1 and project d688ef3e358c4822823707982fe4f654. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:04:58.112520 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d658874-ab48-4a32-b713-83c5a75184a7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093429 Sep 09 23:04:58.120889 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 154/303] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:04:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:04:58.241685 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:58.242966 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:58.254329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:58.260903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:58.261714 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:58.264467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:58.269695 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:58.271696 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:58.546727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:58.547254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:58.562024 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:58.562526 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:58.562978 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:58.563711 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:58.564167 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:58.564594 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:58.830334 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:58.846633 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:58.848387 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:58.849747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22e21f00-d31d-4bde-bafc-de71b113f926 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.307524 Sep 09 23:04:58.850477 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 155/304] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:58 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:04:58.888493 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:04:58.900721 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c213db15-c866-4733-9ef0-6782ab490e11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1277 microversion: 2.1 time: 0.663825 Sep 09 23:04:58.902271 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 150/305] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:58 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1277 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:04:59.375296 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-df02f61c-1969-4774-9e07-c0487e10a8c2 req-1b7c8b9d-0d78-4f51-ba7f-8cbe35e578bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f3832e-f300-4e35-b871-2f2c9dc4cc83", "tag": "26a50981-3889-47e3-800b-120dfa1971a2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:04:59.384706 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-df02f61c-1969-4774-9e07-c0487e10a8c2 req-1b7c8b9d-0d78-4f51-ba7f-8cbe35e578bf service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:59.385421 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-df02f61c-1969-4774-9e07-c0487e10a8c2 req-1b7c8b9d-0d78-4f51-ba7f-8cbe35e578bf service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:59.385845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-df02f61c-1969-4774-9e07-c0487e10a8c2 req-1b7c8b9d-0d78-4f51-ba7f-8cbe35e578bf service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:59.396455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-df02f61c-1969-4774-9e07-c0487e10a8c2 req-1b7c8b9d-0d78-4f51-ba7f-8cbe35e578bf service nova] Creating event network-changed:26a50981-3889-47e3-800b-120dfa1971a2 for instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 on hv-cinder-85221 Sep 09 23:04:59.402762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-df02f61c-1969-4774-9e07-c0487e10a8c2 req-1b7c8b9d-0d78-4f51-ba7f-8cbe35e578bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031419 Sep 09 23:04:59.403356 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 156/306] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:04:59.874879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:59.875557 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:59.881424 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:59.882151 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:59.889031 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:59.889895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:59.890369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:59.890802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:59.927888 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:04:59.929163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:04:59.937811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:59.938725 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:59.939388 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:04:59.940164 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:04:59.948911 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:04:59.951774 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:00.041986 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:00.050434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:00.051913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:00.053329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0043a7ff-1450-40f7-9918-9f4379b54709 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.182591 Sep 09 23:05:00.053876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 151/307] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:04:59 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:00.059531 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-759364598", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b6dd6ff-8b9d-48ad-87d2-8904fbbb0b3d"}], "security_groups": [{"name": "tempest-securitygroup--928497265"}], "key_name": "tempest-keypair-585194700", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:00.098149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:00.106196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-096c74a0-bc64-4e70-b8b9-fbf89396e206 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1277 microversion: 2.1 time: 0.184190 Sep 09 23:05:00.106764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 157/308] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:04:59 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:00.161665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] validate_networks() for [('8b6dd6ff-8b9d-48ad-87d2-8904fbbb0b3d', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:05:00.538231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:05:00.538231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:05:00.538649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:05:00.539103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:05:00.539542 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:05:00.548228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:00.548714 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:00.549154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:00.549884 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:00.550349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:00.550780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:00.567973 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Getting quotas for project d688ef3e358c4822823707982fe4f654. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:05:00.572455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Getting quotas for user e24e6fb4c69d48f7b2972b53fb8ea4a1 and project d688ef3e358c4822823707982fe4f654. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:05:00.583427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:05:00.585755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:05:00.633290 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92f9863c-46b6-4a12-8aae-97e568cb37a6 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.577120 Sep 09 23:05:00.633933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 152/309] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:05:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:05:00.644997 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76de7f8a-9b9e-4bd3-bf06-647078492bd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:00.645607 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76de7f8a-9b9e-4bd3-bf06-647078492bd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:00.701692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-76de7f8a-9b9e-4bd3-bf06-647078492bd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:00.708429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76de7f8a-9b9e-4bd3-bf06-647078492bd5 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1244 microversion: 2.1 time: 0.067236 Sep 09 23:05:00.709211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 158/310] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:00 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:01.080353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:01.081146 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:01.088559 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:01.089146 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:01.089826 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:01.090524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:01.091056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:01.091653 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:01.130124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:01.130940 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:01.135088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:01.139824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:01.140395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:01.140901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:01.141662 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:01.142192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:01.142686 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:01.283473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:01.285669 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:01.292957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2828693-f5fb-4941-9d75-b2d964cdf159 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1277 microversion: 2.1 time: 0.166871 Sep 09 23:05:01.293531 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 159/311] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:01 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:01.308713 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:01.316906 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:01.318340 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:01.319473 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e3c5ef3-6c09-43bd-bd85-f293526f3eb9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.243677 Sep 09 23:05:01.320041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 153/312] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:01 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:01.654058 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd639da0-cfd8-455b-8721-8d070a29e562 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: .version_select at 0x7fcecf45c700>, body: {"keypair": {"name": "tempest-keypair-2012150447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWxyHmvtX4sy1A6cCQvfl7Qql+6pBQqhqHxAixNmbQWIMw67uOCYyF7h942UbNqW+8WfzP44vu3AcjPSgGPdRMYtOP7swrRdebbhj2Wn+lBej3AKUBkYm8eUlR7JchPUg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:01.670752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-bd639da0-cfd8-455b-8721-8d070a29e562 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for project cba38c443abf49a48bdb55f42dac68b0. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:05:01.674511 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-bd639da0-cfd8-455b-8721-8d070a29e562 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for user 85cd8a90230b4c69886534be67acd943 and project cba38c443abf49a48bdb55f42dac68b0. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:05:01.676797 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:01.698345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd639da0-cfd8-455b-8721-8d070a29e562 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048269 Sep 09 23:05:01.698963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 160/313] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:05:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:01.735584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:01.736409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:01.742255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:01.742934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:01.743365 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:01.744101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:01.744553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:01.745003 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:01.807230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:01.814709 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-321b5700-f0c1-42f2-a35c-421d68e27cf1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1248 microversion: 2.1 time: 0.083028 Sep 09 23:05:01.815268 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 154/314] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:01 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:02.317721 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:02.318278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:02.326081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:02.326642 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:02.327089 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:02.327832 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:02.328323 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:02.328712 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:02.344967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:02.345852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:02.352974 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:02.353869 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:02.354476 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:02.355216 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:02.356011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:02.356804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:02.491305 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:02.500633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:02.502107 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:02.503267 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d8aaf91-24ac-472f-9174-7e59bd9810da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.162450 Sep 09 23:05:02.503858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 155/315] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:02 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:02.516566 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:02.527845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11891f11-836a-4f6a-9f6d-f875170f9fb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1277 microversion: 2.1 time: 0.214633 Sep 09 23:05:02.528413 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 161/316] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:02 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:02.839384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:02.839961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:02.845826 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:02.846311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:02.846946 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:02.847678 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:02.848139 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:02.848566 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:02.912462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:02.921224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3fa4057-dcc1-4cd1-8670-147e56074a51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1248 microversion: 2.1 time: 0.085879 Sep 09 23:05:02.921789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 156/317] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:02 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:03.052387 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2074798512", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1317db-d467-415d-ab18-3336278fd50c"}], "security_groups": [{"name": "tempest-securitygroup--1892566387"}], "key_name": "tempest-keypair-2012150447", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:03.152822 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] validate_networks() for [('2c1317db-d467-415d-ab18-3336278fd50c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:05:03.518016 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:05:03.518470 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:05:03.518967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:05:03.519378 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:05:03.519819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:05:03.529104 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:03.529581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:03.529700 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:03.530140 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:03.530298 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:03.530722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:03.531178 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:03.531646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:03.536405 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:03.536889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:03.537328 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:03.538020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:03.538477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:03.538937 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:03.548568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for project cba38c443abf49a48bdb55f42dac68b0. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:05:03.551771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for user 85cd8a90230b4c69886534be67acd943 and project cba38c443abf49a48bdb55f42dac68b0. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:05:03.562845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:05:03.565171 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:05:03.612916 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-083c6b82-e489-420e-9693-501c75e92b32 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565008 Sep 09 23:05:03.613559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 162/318] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:05:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:05:03.618298 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:03.618904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:03.625248 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:03.625735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:03.626279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:03.626980 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:03.627433 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:03.628417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:03.703111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:03.713061 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:03.714836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:03.716102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e297ab9-b45e-48cb-9f97-ccd7a7b7efd8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1740 microversion: 2.20 time: 0.190255 Sep 09 23:05:03.716852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 157/319] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:03 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:03.737207 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03ddc18d-9689-41fa-b4b9-0e448f33ddd4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:03.737819 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03ddc18d-9689-41fa-b4b9-0e448f33ddd4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:03.780201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:03.788254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-69b5b940-ac24-4bae-9a6a-aefde0af52eb tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1277 microversion: 2.1 time: 0.173527 Sep 09 23:05:03.788852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 163/320] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:03 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:03.800462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-03ddc18d-9689-41fa-b4b9-0e448f33ddd4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:03.808786 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03ddc18d-9689-41fa-b4b9-0e448f33ddd4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1242 microversion: 2.1 time: 0.075356 Sep 09 23:05:03.809344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 158/321] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:03 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:03.944839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:03.946022 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:03.951838 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:03.952352 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:03.952789 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:03.953472 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:03.953924 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:03.954347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:04.018030 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:04.025631 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-790f9ae4-f6f6-4365-9384-80ed207eb8b2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1248 microversion: 2.1 time: 0.084707 Sep 09 23:05:04.032188 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 164/322] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:03 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:04.747153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:04.748908 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:04.756494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:04.757289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:04.757961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:04.759361 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:04.760865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:04.761479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:04.811781 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:04.812440 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:04.818565 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:04.819050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:04.819482 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:04.820195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:04.820644 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:04.821060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:05.029312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:05.038408 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6f48379a-36ed-4d82-a610-4363f80c72ce tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1277 microversion: 2.1 time: 0.231320 Sep 09 23:05:05.039475 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 165/323] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:04 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:05.049072 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:05.050212 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:05.056981 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:05.057676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:05.058445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:05.059312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:05.060110 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:05.060701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:05.112747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:05.127307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:05.128774 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:05.130565 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba497d5e-ae05-4be1-8c9a-cc42e9821a35 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1722 microversion: 2.20 time: 0.392880 Sep 09 23:05:05.131349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 159/324] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:04 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:05.136829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:05.138836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:05.144361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:05.145419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:05.145970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:05.146506 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:05.147225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:05.147708 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:05.148892 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:05.161496 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d225f846-9242-4e03-b48f-b35134c68274 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1238 microversion: 2.1 time: 0.116178 Sep 09 23:05:05.162068 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 166/325] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:05 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:05.217435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:05.226840 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1dedf24f-5446-4b51-ab89-725f32d8ec1e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1296 microversion: 2.1 time: 0.093499 Sep 09 23:05:05.226840 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 160/326] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:05 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:06.062050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:06.062663 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:06.069038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:06.069514 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:06.069948 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:06.070658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:06.071110 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:06.072061 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:06.158148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:06.159053 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:06.165048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:06.165529 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:06.166151 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:06.166845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:06.167298 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:06.167743 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:06.192371 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:06.203618 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:06.211253 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c847feb-c559-4805-a286-6897b8f05c43 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.153039 Sep 09 23:05:06.211851 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 167/327] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:06 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:06.217035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:06.217810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:06.226516 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:06.227255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:06.227719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:06.228570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:06.229031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:06.229452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:06.301537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:06.309377 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0f9a301-7dc0-475d-970e-327d90366c9a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1294 microversion: 2.1 time: 0.095846 Sep 09 23:05:06.309936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 168/328] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:06 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:06.314522 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:06.315293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:06.320825 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:06.322028 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:06.322638 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:06.323741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:06.324202 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:06.324626 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:06.326143 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:06.334622 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:06.336185 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:06.337971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f564387e-cee9-403f-81ec-6e878bb08749 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1722 microversion: 2.20 time: 0.183177 Sep 09 23:05:06.338533 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 161/329] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:06 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:06.390361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:06.397918 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5c6d7d9-1c1c-43e5-9d3e-b3796346f1f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1314 microversion: 2.1 time: 0.086877 Sep 09 23:05:06.398477 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 169/330] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:06 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1314 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:07.234935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:07.235648 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:07.242296 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:07.242782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:07.243251 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:07.243956 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:07.244414 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:07.244844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:07.332279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:07.332885 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:07.340615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:07.341104 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:07.341539 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:07.342231 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:07.342689 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:07.343113 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:07.377590 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:07.385905 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b00d8fa-7a7e-4df9-b7ff-fc7499684297 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.154855 Sep 09 23:05:07.386474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 162/331] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:07 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:07.401832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:07.402434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:07.407973 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:07.408320 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:07.408805 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:07.409601 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:07.410301 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:07.410755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:07.411179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:07.417057 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-319784f7-fb9b-46d3-aa1f-225a43729148 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1294 microversion: 2.1 time: 0.086916 Sep 09 23:05:07.417057 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 170/332] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:07 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:07.421102 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:07.421702 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:07.427643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:07.428235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:07.428782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:07.429559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:07.430135 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:07.430692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:07.491643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:07.499452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2f0cd99-603b-445d-b386-15e82ed45b3e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1314 microversion: 2.1 time: 0.081861 Sep 09 23:05:07.500041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 171/333] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:07 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1314 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:07.544715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:07.552953 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:07.554435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:07.555611 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9d12f2df-d165-4b72-8cbb-ba4e1d15c6f1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1722 microversion: 2.20 time: 0.158084 Sep 09 23:05:07.556176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 163/334] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:07 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:08.408692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:08.409898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:08.418196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.419618 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.420270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.421528 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.422196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.422824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.439702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:08.440909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:08.453330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:08.455691 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.456433 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.457097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.458606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.459929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.461447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.597531 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:08.610872 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:08.620214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82e897f1-7181-40c7-ab30-7eec6ebdf775 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1294 microversion: 2.1 time: 0.185467 Sep 09 23:05:08.621356 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-85fb8eff-b5f6-4a8f-a8c4-71258605122e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.216360 Sep 09 23:05:08.635530 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 172/335] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:08 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:08.635530 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:08.635530 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:08.637011 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.637733 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.638003 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 164/336] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:08 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1294 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:08.638593 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.639513 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.640155 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.641182 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.644690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-06b79838-3aee-482b-973d-75316657abf2 req-f67e0861-6c4a-49f1-a6e6-ad99d7e6d363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2052a904-5812-447c-b0ac-d3c9dc4321cb", "name": "network-vif-unplugged", "status": "completed", "tag": "37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:08.655460 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06b79838-3aee-482b-973d-75316657abf2 req-f67e0861-6c4a-49f1-a6e6-ad99d7e6d363 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.656116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06b79838-3aee-482b-973d-75316657abf2 req-f67e0861-6c4a-49f1-a6e6-ad99d7e6d363 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.656770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06b79838-3aee-482b-973d-75316657abf2 req-f67e0861-6c4a-49f1-a6e6-ad99d7e6d363 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.669999 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-06b79838-3aee-482b-973d-75316657abf2 req-f67e0861-6c4a-49f1-a6e6-ad99d7e6d363 service nova] Creating event network-vif-unplugged:37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba for instance 2052a904-5812-447c-b0ac-d3c9dc4321cb on hv-cinder-85221 Sep 09 23:05:08.675092 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-06b79838-3aee-482b-973d-75316657abf2 req-f67e0861-6c4a-49f1-a6e6-ad99d7e6d363 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035845 Sep 09 23:05:08.676333 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 165/337] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:08.684064 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:08.684744 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:08.691220 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.691746 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.692179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.693019 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:08.693471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:08.693896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:08.743852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:08.752380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd98a567-a151-4b56-97e2-039fe2f3d776 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1302 microversion: 2.1 time: 0.129143 Sep 09 23:05:08.752985 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 173/338] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:08 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:08.911509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:08.920193 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:08.921638 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:08.922785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35be6e81-de0b-4622-a797-87aacfa4eb3d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1722 microversion: 2.20 time: 0.244512 Sep 09 23:05:08.923338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 166/339] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:08 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:09.365996 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:09.366490 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:09.372994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.373483 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.373914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.374603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.375155 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.375468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.514232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lazy-loading 'services' on Instance uuid 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:05:09.630742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4760e6c-51e0-441e-b4e6-62b57eb05b4a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2/os-volume_attachments/34ddf2ab-36fb-468e-b762-dd5612f16f73" status: 202 len: 0 microversion: 2.1 time: 0.268500 Sep 09 23:05:09.631358 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 174/340] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:05:09 2022] DELETE /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2/os-volume_attachments/34ddf2ab-36fb-468e-b762-dd5612f16f73 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:05:09.647603 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:09.648230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:09.654692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.655177 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.655638 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.656331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.656785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.657400 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.663697 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:09.664643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:09.671139 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.672331 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.672943 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.673646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.674603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.675059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.746666 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:09.754448 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6798663-aa5d-4245-b4be-3cba24be47e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1294 microversion: 2.1 time: 0.094947 Sep 09 23:05:09.755368 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 175/341] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:09 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:09.775758 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:09.776361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:09.782967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.783691 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.784123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.784812 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.785269 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.785758 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.805524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:09.813652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62936868-de9f-4260-958a-6a5fa48ab1fa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.169858 Sep 09 23:05:09.814213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 167/342] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:09 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:09.916618 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:09.924182 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9cd82be2-60c3-45be-84bd-005dfceb842f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.152441 Sep 09 23:05:09.924746 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 176/343] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:09 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:09.948315 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:09.948830 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:09.954584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.955063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.955530 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:09.956210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:09.956676 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:09.957078 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:10.081974 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:10.089804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:10.091230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:10.092398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3cf12512-5a73-4497-a284-9a57d83a7f9b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1722 microversion: 2.20 time: 0.147997 Sep 09 23:05:10.092947 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 168/344] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:09 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:10.779145 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:10.780462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:10.787300 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:10.788150 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:10.788963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:10.789445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:10.789948 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:10.790405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:10.807646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:10.838601 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:10.840524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:10.845375 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:10.851039 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:10.851832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:10.852486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:10.853547 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:10.854162 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:10.854741 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:10.917294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:10.926887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53d7b036-94ca-44fc-96d0-36c355d7ee6a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1294 microversion: 2.1 time: 0.152692 Sep 09 23:05:10.935850 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 177/345] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:10 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1294 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:10.948092 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:10.948699 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:10.955177 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:10.955705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:10.956143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:10.956922 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:10.957369 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:10.958053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.096941 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:11.104598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5295df86-f8e1-458e-a39d-1afbcefcc08e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.161166 Sep 09 23:05:11.105154 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 178/346] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:10 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:11.117822 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:11.117997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:11.119303 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:11.125543 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.126022 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.126479 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.127169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.127649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.128144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.128523 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2352846b-cd3b-434d-9d40-00915709de87 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.296094 Sep 09 23:05:11.129657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 169/347] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:10 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:11.268209 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:11.276420 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:11.277857 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:11.279006 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-95c3074f-0ca7-40d8-b0fb-c0c8954a37f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1725 microversion: 2.20 time: 0.165285 Sep 09 23:05:11.279574 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 179/348] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:11 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:11.304387 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feffbab5-11b8-4978-a112-c95c86a624f0"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:11.307581 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:11.313460 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.313947 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.314382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.315073 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.315583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.316014 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.610115 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ed652be8-4815-4f3d-8f79-adfd3b6a5534 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309891 Sep 09 23:05:11.610962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 170/349] 10.222.0.17 () {62 vars in 1364 bytes} [Fri Sep 9 23:05:11 2022] POST /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:05:11.738525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:11.739112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:11.745015 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.745490 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.745917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.746594 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.747040 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.747457 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.788194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c93ab195-3106-444c-9372-91997f44bfe0 req-7bdfd425-df58-41fe-a38e-364150b588e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f905f7dd-b5b2-42ab-a9a4-742d480a26a8", "tag": "ef102868-6f48-4e8a-8ce3-bb2980127db1"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:11.794954 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120598) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 23:05:11.799024 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c93ab195-3106-444c-9372-91997f44bfe0 req-7bdfd425-df58-41fe-a38e-364150b588e8 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.799815 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c93ab195-3106-444c-9372-91997f44bfe0 req-7bdfd425-df58-41fe-a38e-364150b588e8 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.800487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c93ab195-3106-444c-9372-91997f44bfe0 req-7bdfd425-df58-41fe-a38e-364150b588e8 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.811611 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c93ab195-3106-444c-9372-91997f44bfe0 req-7bdfd425-df58-41fe-a38e-364150b588e8 service nova] Creating event network-changed:ef102868-6f48-4e8a-8ce3-bb2980127db1 for instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 on hv-cinder-85221 Sep 09 23:05:11.817909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c93ab195-3106-444c-9372-91997f44bfe0 req-7bdfd425-df58-41fe-a38e-364150b588e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033154 Sep 09 23:05:11.818999 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 171/350] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:05:11.872651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9943aef4-6deb-45ff-b474-544a331094ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/action" status: 202 len: 0 microversion: 2.20 time: 0.137964 Sep 09 23:05:11.873254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 180/351] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 9 23:05:11 2022] POST /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:05:11.881854 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:11.882549 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:11.889285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.889776 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.890230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.890922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.891368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.891815 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.954225 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:11.955227 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:11.961729 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.962749 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.963189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:11.963917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:11.964376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:11.964797 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:12.030173 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:12.030499 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:12.038698 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1be1b4e7-7505-4022-8795-7117c87f7c73 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1294 microversion: 2.1 time: 0.088646 Sep 09 23:05:12.052035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 181/352] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:11 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:12.052382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:12.052382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:12.052382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef70dd6c-5bc8-4396-8567-2a7b82de9b32 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1811 microversion: 2.20 time: 0.168090 Sep 09 23:05:12.052629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 172/353] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:11 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1811 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:12.129615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:12.130327 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:12.136931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:12.137423 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:12.137865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:12.138868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:12.139337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:12.139795 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:12.152879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:12.153485 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:12.159238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:12.159763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:12.160196 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:12.161245 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:12.161699 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:12.162123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:12.281649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:12.289388 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-69cede08-fe83-4b41-839f-694cf9342d5e tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.163478 Sep 09 23:05:12.302795 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:12.303807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 182/354] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:12 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:12.310678 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa4952d8-febc-4ea9-a938-e975e7188968 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.162196 Sep 09 23:05:12.311343 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 173/355] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:12 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:13.062795 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:13.063411 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:13.070137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:13.070742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:13.070742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:13.071141 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:13.071346 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:13.071797 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:13.072260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:13.072712 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:13.077306 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:13.077794 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:13.078228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:13.078929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:13.079382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:13.079841 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:13.136966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:13.144853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1382a00a-b40e-4091-93b7-41e7a05bec25 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1294 microversion: 2.1 time: 0.085932 Sep 09 23:05:13.145514 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 183/356] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:13 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:13.215237 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:13.223786 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:13.225235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:13.226382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54311cdc-6486-4bd8-b4d5-d41df70104e3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1811 microversion: 2.20 time: 0.160200 Sep 09 23:05:13.226943 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 174/357] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:13 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:13.312301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:13.312965 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:13.318883 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:13.319371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:13.319839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:13.320531 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:13.320984 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:13.321407 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:13.333997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:13.334605 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:13.340928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:13.341411 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:13.341848 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:13.342541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:13.342998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:13.343427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:13.454599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:13.462783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cdae1c5b-9b6e-4818-95b8-064d71342c1d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.154402 Sep 09 23:05:13.463353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 184/358] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:13 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:13.475866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:13.484249 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f874713a-613d-4a5f-b8fb-c4266e07c933 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.154116 Sep 09 23:05:13.484815 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 175/359] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:13 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:14.169176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:14.169796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:14.171658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:14.172337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=22 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:14.179118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:14.179628 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:14.180067 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:14.180759 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:14.181215 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:14.181643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:14.242198 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:14.249886 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88b65420-c4b3-4069-83e4-628f20494858 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1294 microversion: 2.1 time: 0.085117 Sep 09 23:05:14.250446 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 185/360] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:14 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:14.252239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:14.252850 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:14.254775 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:14.261342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:14.261826 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:14.262263 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:14.262955 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:14.263408 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:14.263878 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:14.404598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:14.406773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:14.415588 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:14.417496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:14.418750 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-76ef260e-3c0b-455d-85c4-9f4b6175f05a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1811 microversion: 2.20 time: 0.170465 Sep 09 23:05:14.419479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 176/361] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:14 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:14.486577 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:14.487317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:14.493501 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:14.493918 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:14.494354 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:14.495041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:14.495516 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:14.495970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:14.507395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:14.508032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:14.515301 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:14.515759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:14.516478 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:14.516876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:14.517329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:14.517749 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:14.630317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:14.639369 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15bb2f6e-8cfa-4016-8a9e-f5d167e04218 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.156602 Sep 09 23:05:14.639986 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 186/362] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:14 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:14.656837 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:14.664405 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44de9a44-135f-4aa1-8ad6-10be47dcd4f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.161132 Sep 09 23:05:14.664966 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 177/363] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:14 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:15.275184 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:15.276699 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:15.285096 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:15.286316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:15.286927 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:15.287811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:15.288632 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:15.289356 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:15.366767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:15.377490 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84b27147-bea2-47ce-bb91-d2217f5a1b55 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1312 microversion: 2.1 time: 0.106988 Sep 09 23:05:15.378155 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 187/364] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:15 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:15.446799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:15.447291 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:15.457377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:15.457881 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:15.458597 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:15.459427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:15.460084 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:15.460508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:15.662291 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:15.662903 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:15.669420 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:15.669904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:15.670339 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:15.671038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:15.671522 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:15.671943 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:15.678804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:15.694425 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:15.696532 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:15.698507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2092c0ad-747b-4b79-8801-29853b5bdc7e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1811 microversion: 2.20 time: 0.256493 Sep 09 23:05:15.699266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 178/365] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:15 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1811 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:15.723401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:15.724442 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:15.732106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:15.732796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:15.733367 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:15.734674 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:15.734765 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:15.735234 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:15.826073 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:15.833994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8913d6f-2cb8-49ee-ad62-6f0e0b13ba17 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.175641 Sep 09 23:05:15.834573 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 188/366] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:15 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:15.880559 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:15.888652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bfedbf8-a374-4627-82b3-41f4e86c1555 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.171090 Sep 09 23:05:15.889216 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 179/367] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:15 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:16.126959 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:16.127802 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:16.136894 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.137395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.137842 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.138553 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.139017 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.139444 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.165453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:05:16.294827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c3ea2ad8-1304-4dfa-b9bb-187b40a88ef1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 204 len: 0 microversion: 2.1 time: 0.171999 Sep 09 23:05:16.296685 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 189/368] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:05:16 2022] DELETE /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:05:16.306294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:16.308407 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:16.318791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.319458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.320094 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.321209 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.322608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.323387 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.402853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:16.403636 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:16.409707 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.410344 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.410810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.411833 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.412363 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.412954 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.511937 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:16.520682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af8bca4d-4375-4d46-a32c-d63d1b81bd1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1300 microversion: 2.1 time: 0.122476 Sep 09 23:05:16.521419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 190/369] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:16 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:16.532101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:16.541425 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4c0f4211-2ee9-4ca5-a4b6-68e752692570 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1513 microversion: 2.1 time: 0.239058 Sep 09 23:05:16.542200 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 180/370] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:16 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:16.730679 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:16.731369 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:16.739407 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.740806 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.740806 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.741258 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.742208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.742412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.760067 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:16.864283 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:16.864890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:16.874198 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.874692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.875134 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.877441 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.877930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.878367 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.903819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:16.913336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:16.914883 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:16.916676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eab05dda-60ea-4ee3-a96c-627da08ca182 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1753 microversion: 2.20 time: 0.190440 Sep 09 23:05:16.917425 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 191/371] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:16 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:16.931763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:16.932468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:16.938993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.939568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.939999 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:16.940727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:16.941200 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:16.941685 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:17.026666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:17.035046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f2592ec9-314d-4e29-b2de-bd2dd8cc4bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.174373 Sep 09 23:05:17.035678 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 181/372] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:16 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:17.088362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:17.096088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ebc56272-075c-44d5-996c-e72e6f742b3a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.177696 Sep 09 23:05:17.096643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 192/373] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:16 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:17.544823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:17.545461 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:17.551934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:17.552668 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:17.553098 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:17.553782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:17.554233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:17.554655 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:17.566224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:17.566837 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:17.573438 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:17.573948 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:17.574377 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:17.575060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:17.575531 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:17.575977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:17.690018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:17.698276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-acd62d63-cdda-4151-9005-be2c2d870fc4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.157207 Sep 09 23:05:17.700219 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 182/374] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:17 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:17.709123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:17.719512 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dfa5cdd7-bf8b-4386-9859-eda8818c7e98 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1513 microversion: 2.1 time: 0.156971 Sep 09 23:05:17.720105 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 193/375] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:17 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:17.943627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:17.944156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:17.950049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:17.950535 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:17.950968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:17.951702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:17.952157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:17.952581 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.058426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:18.059186 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:18.062208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:18.066471 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:18.066966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:18.067405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.068127 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:18.068586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:18.069013 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.080178 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:18.089438 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:18.090994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:18.092194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22bbca57-43c1-4641-913a-1d1c50e33d42 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1753 microversion: 2.20 time: 0.152694 Sep 09 23:05:18.092753 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 183/376] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:17 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:18.119777 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:18.120382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:18.126764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:18.127244 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:18.127702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.128384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:18.128833 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:18.129255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.204656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:18.213039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6fdd532e-2b8c-4dc3-8cc1-1c32207d8d16 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.158452 Sep 09 23:05:18.213605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 194/377] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:18 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:18.261817 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:18.269466 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ea3fc44-1f58-4dfb-812e-b33a0b14bab5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.153857 Sep 09 23:05:18.270027 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 184/378] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:18 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:18.722788 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:18.723390 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:18.731034 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:18.731534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:18.731966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.732653 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:18.733099 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:18.733514 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.742095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:18.742790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:18.749365 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:18.749886 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:18.750323 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.751022 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:18.751482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:18.751933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:18.865988 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:18.873619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-514de662-1dbd-4f69-b0fd-650ec96b400c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.154748 Sep 09 23:05:18.874372 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 195/379] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:18 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:18.887179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:18.895099 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eac7345b-01c4-4368-a7b6-9a9fd2f87b3e tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1513 microversion: 2.1 time: 0.156861 Sep 09 23:05:18.895677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 185/380] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:18 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:19.117342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:19.118372 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:19.124286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.124772 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.125206 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.125895 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.126347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.126778 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.235717 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:19.236441 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:19.242415 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.243477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.244155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.244937 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.245455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.246060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.256158 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:19.265319 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:19.266748 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:19.267929 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ce5d5fb0-74cb-48c2-aba1-38d13cabab01 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1753 microversion: 2.20 time: 0.154531 Sep 09 23:05:19.268494 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 196/381] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:19 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:19.292644 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:19.293243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:19.299457 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.299971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.300402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.301096 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.301528 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.301944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.375910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:19.384422 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d02834da-6015-4fa4-9934-8c998d722533 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.151778 Sep 09 23:05:19.384992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 186/382] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:19 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:19.434365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:19.443268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0d68ec0-1f78-4f6a-8857-7af5667b3980 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.154373 Sep 09 23:05:19.443889 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 197/383] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:19 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:19.897491 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:19.898673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:19.906084 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.906565 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.907147 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.907905 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.908362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.908789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.918588 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:19.919197 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:19.925695 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.926176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.926612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:19.927582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:19.928208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:19.928824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:20.069918 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:20.077603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8bee1182-3970-4106-a7dc-ff4ad8b0c749 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1513 microversion: 2.1 time: 0.163387 Sep 09 23:05:20.078662 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 198/384] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:19 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:20.199427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:20.210810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c61e5b8-634a-459d-ac68-cda149d043d2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.316721 Sep 09 23:05:20.213396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 187/385] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:19 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:20.292382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:20.293329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:20.299316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:20.299854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:20.300276 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:20.300971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:20.301428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:20.301847 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:20.406652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:20.407250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:20.413619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:20.414109 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:20.414665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:20.415398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:20.415882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:20.416303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:20.438229 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:20.450103 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:20.451687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:20.452954 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70511cf6-af5d-466e-a7d3-978a88c0f989 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1753 microversion: 2.20 time: 0.164653 Sep 09 23:05:20.453656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 199/386] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:20 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:20.466316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:20.467047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:20.473115 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:20.473682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:20.474192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:20.474962 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:20.475508 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:20.476018 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:20.607690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:20.609143 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:20.617829 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8bae18a4-410c-48ca-ac05-0585796ccf11 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.155748 Sep 09 23:05:20.620072 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35b12952-ae14-45b1-b7a4-8d17ea584be7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.216987 Sep 09 23:05:20.631510 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 188/387] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:20 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:20.635353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 200/388] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:20 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:20.643825 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f1f484e7-cbb8-435a-897b-0349206d915f req-b9fdea44-fe8f-4e2c-a86f-81ff2eaa8e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62121a3-5749-4ac2-887a-4eb11c33363f", "tag": "f19a26dd-ed5c-4abb-8b1b-6ec798d9c3a6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:20.654179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1f484e7-cbb8-435a-897b-0349206d915f req-b9fdea44-fe8f-4e2c-a86f-81ff2eaa8e7c service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:20.654782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1f484e7-cbb8-435a-897b-0349206d915f req-b9fdea44-fe8f-4e2c-a86f-81ff2eaa8e7c service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:20.655316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1f484e7-cbb8-435a-897b-0349206d915f req-b9fdea44-fe8f-4e2c-a86f-81ff2eaa8e7c service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:20.667246 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f1f484e7-cbb8-435a-897b-0349206d915f req-b9fdea44-fe8f-4e2c-a86f-81ff2eaa8e7c service nova] Creating event network-changed:f19a26dd-ed5c-4abb-8b1b-6ec798d9c3a6 for instance d62121a3-5749-4ac2-887a-4eb11c33363f on hv-cinder-85221 Sep 09 23:05:20.672538 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f1f484e7-cbb8-435a-897b-0349206d915f req-b9fdea44-fe8f-4e2c-a86f-81ff2eaa8e7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032664 Sep 09 23:05:20.673597 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 189/389] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:05:21.101290 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:21.102087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:21.109605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.110089 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.110518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.111283 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.111760 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.112180 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.234869 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:21.240731 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:21.248875 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.249658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.250302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.251215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.251907 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.252548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.266343 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:21.275162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa87a415-7e98-4b7b-89d3-ac829b1bb30b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1513 microversion: 2.1 time: 0.178304 Sep 09 23:05:21.291639 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 201/390] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:21 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:21.479139 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:21.479804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:21.485977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.486586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.487229 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.488077 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.488686 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.489254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.567267 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:21.580011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d3a1db1-563c-4ee2-a586-6a14f79f3899 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.349142 Sep 09 23:05:21.599442 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 190/391] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:21 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:21.635855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:21.642204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:21.642889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:21.647574 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:21.649621 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:21.650664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.650953 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3adbe3e-f0c8-4e7e-80be-ce42dc0a27ec tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.176317 Sep 09 23:05:21.651144 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.651682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 202/392] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:21 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:21.651976 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.654025 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.654783 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.655231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.657382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:21.658190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:21.666307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.667693 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.668330 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.669406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:21.670179 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:21.670781 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:21.828576 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:21.837840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10dc7c11-671b-4aba-9693-16204716879f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.184724 Sep 09 23:05:21.838753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 203/393] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:21 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:21.968653 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:21.976333 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2f2292b-b52b-4387-9b7b-ded21d991759 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.337984 Sep 09 23:05:21.976895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 191/394] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:21 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:22.213286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-db6825f4-7a95-47c5-8198-b28412b09306 req-1a419b66-a1e8-4998-bbd9-202a9b5ce2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f3832e-f300-4e35-b871-2f2c9dc4cc83", "name": "network-vif-plugged", "status": "completed", "tag": "26a50981-3889-47e3-800b-120dfa1971a2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:22.226788 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-db6825f4-7a95-47c5-8198-b28412b09306 req-1a419b66-a1e8-4998-bbd9-202a9b5ce2f5 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.227887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-db6825f4-7a95-47c5-8198-b28412b09306 req-1a419b66-a1e8-4998-bbd9-202a9b5ce2f5 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.228480 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-db6825f4-7a95-47c5-8198-b28412b09306 req-1a419b66-a1e8-4998-bbd9-202a9b5ce2f5 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.240581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-db6825f4-7a95-47c5-8198-b28412b09306 req-1a419b66-a1e8-4998-bbd9-202a9b5ce2f5 service nova] Creating event network-vif-plugged:26a50981-3889-47e3-800b-120dfa1971a2 for instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 on hv-cinder-85221 Sep 09 23:05:22.247414 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-db6825f4-7a95-47c5-8198-b28412b09306 req-1a419b66-a1e8-4998-bbd9-202a9b5ce2f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038855 Sep 09 23:05:22.248762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 204/395] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:22.298735 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:22.299350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:22.308368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.309070 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.309510 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.310858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.312294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.312742 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.351452 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.352211 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.352772 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.353296 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lazy-loading 'fault' on Instance uuid 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:05:22.611078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:22.611823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:22.618769 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.619407 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.619883 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.620599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.621059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.621486 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.706994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:22.721271 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c09c3649-1107-4332-b61a-196ee3701d97 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1308 microversion: 2.1 time: 0.426726 Sep 09 23:05:22.722120 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 192/396] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:22 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:22.727936 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:22.728752 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:22.734893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.735704 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.736323 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.737315 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.737768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.738193 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.762293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:22.770871 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c3aac9f-d374-47e4-8197-79fdbbc6f958 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.164065 Sep 09 23:05:22.771888 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 205/397] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:22 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:22.776186 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b0f4a912-dc21-442d-86a9-9c3b2a5416e5 req-1e0de223-a6df-449a-b5af-193daa6d64e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee743f1-88ac-4570-90da-c9f8a2edc5e2", "name": "network-vif-deleted", "tag": "b3d517ce-0d04-47e7-aba8-fca9bd3c5569"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:22.785238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b0f4a912-dc21-442d-86a9-9c3b2a5416e5 req-1e0de223-a6df-449a-b5af-193daa6d64e6 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.785718 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b0f4a912-dc21-442d-86a9-9c3b2a5416e5 req-1e0de223-a6df-449a-b5af-193daa6d64e6 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.786147 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b0f4a912-dc21-442d-86a9-9c3b2a5416e5 req-1e0de223-a6df-449a-b5af-193daa6d64e6 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.798126 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b0f4a912-dc21-442d-86a9-9c3b2a5416e5 req-1e0de223-a6df-449a-b5af-193daa6d64e6 service nova] Creating event network-vif-deleted:b3d517ce-0d04-47e7-aba8-fca9bd3c5569 for instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 on hv-cinder-85221 Sep 09 23:05:22.803820 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b0f4a912-dc21-442d-86a9-9c3b2a5416e5 req-1e0de223-a6df-449a-b5af-193daa6d64e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030887 Sep 09 23:05:22.804425 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 206/398] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:22.861565 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:22.862264 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:22.869569 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.870059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.870498 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.871192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:22.871678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:22.872104 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:22.885579 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:22.888045 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:22.895572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:22.897027 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:22.898198 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d757320-07fd-455b-8705-b60e8be9a359 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.174452 Sep 09 23:05:22.898766 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 193/399] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:22 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:23.000677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:23.000811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:23.001418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:23.007575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.008156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.008289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a484d0ff-0a57-4e87-a80a-ebbd65d6db49 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.150887 Sep 09 23:05:23.008713 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.009156 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 207/400] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:22 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:23.009664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.010188 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.010683 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.141307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:23.149536 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3debe7e-5a18-4069-8cbf-ddb29f547c4a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.152294 Sep 09 23:05:23.150372 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 194/401] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:22 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:23.745404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:23.746019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:23.752412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.752886 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.753316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.753999 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.754450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.754869 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.784767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.785237 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.785669 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.786107 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lazy-loading 'fault' on Instance uuid 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:05:23.793845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:23.794448 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:23.800743 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.801220 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.801652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.802595 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.803043 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.803465 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.833337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:23.841139 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6371e187-65b7-4028-b746-6767a0539d1f tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1308 microversion: 2.1 time: 0.100106 Sep 09 23:05:23.841705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 208/402] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:23 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:23.924423 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:23.925028 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:23.931758 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.932239 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.932668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.933349 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:23.933484 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:23.933802 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:23.934217 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:23.938328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:23.941676 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-845bca76-9d89-4700-9e9b-df6e4f1cd165 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.151699 Sep 09 23:05:23.942383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 195/403] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:23 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:24.030096 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:24.030699 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:24.036467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.036943 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.037374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:24.038058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.038513 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.038935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:24.064527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:24.073119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:24.074550 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:24.075729 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f6be778-e43a-4265-8ce6-949ba79353f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.155212 Sep 09 23:05:24.076534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 209/404] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:23 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:24.167964 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:24.174882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:24.175539 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:24.176235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ad9d424-6f0d-47e2-b604-43c483ca3f72 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.149800 Sep 09 23:05:24.176888 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 196/405] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:24 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:24.183426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.183946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.184434 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:24.185053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.185509 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.185935 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:24.318103 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:24.325616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b252de15-706c-4c86-bd61-b5e5b9afa427 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.154747 Sep 09 23:05:24.326174 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 210/406] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:24 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:24.863556 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:24.864163 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:24.870589 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.871066 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.871508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:24.872210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.872661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.873081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:24.904046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.904526 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.904961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:24.905409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lazy-loading 'fault' on Instance uuid 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:05:24.945508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:24.953541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c19390d8-5771-4939-a31c-f1b05da60cb8 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1308 microversion: 2.1 time: 0.093902 Sep 09 23:05:24.954125 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 197/407] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:24 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:24.965440 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:24.966055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:24.972417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.972895 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.973334 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:24.974023 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:24.974479 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:24.974912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:25.111067 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:25.115184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:25.116395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:25.124703 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:25.127989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0137b12-af8f-4e90-800d-3746c8520a31 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.166573 Sep 09 23:05:25.128604 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:25.129072 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:25.129801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:25.130263 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:25.130694 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:25.132135 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 211/408] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:24 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:25.202173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:25.202910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:25.210747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:25.212990 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:25.214023 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:25.214838 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:25.215454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:25.216089 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:25.382865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:25.391366 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e67f396-3131-4781-99b4-b3abc77550a2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.193455 Sep 09 23:05:25.395576 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 212/409] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:25 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:25.396859 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:25.397469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:25.403857 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:25.403857 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:25.404299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:25.404987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:25.405448 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:25.406325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:25.424003 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:25.433706 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:25.435148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:25.436378 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea6dc225-a214-45d8-8631-3028a69cc474 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.339606 Sep 09 23:05:25.436945 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 198/410] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:25 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:25.542453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:25.551609 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-001e6531-0785-4f7c-894c-5db58a5c96d5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.158276 Sep 09 23:05:25.552220 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 213/411] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:25 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:25.976833 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:25.978037 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:25.984403 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:25.984865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:25.985301 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:25.985976 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:25.986423 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:25.986841 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.016157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.016628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.017052 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.017485 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lazy-loading 'fault' on Instance uuid 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:05:26.061487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:26.068996 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66e9fce8-6886-4676-a9ca-a6c009603306 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 200 len: 1308 microversion: 2.1 time: 0.096039 Sep 09 23:05:26.069546 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 199/412] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:25 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:26.151754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:26.152394 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:26.158764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.159241 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.159713 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.160404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.160856 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.161277 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.288811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:26.296714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-712a177a-1a21-48da-ace1-98efc9284660 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.149338 Sep 09 23:05:26.297379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 214/413] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:26 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:26.419668 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:26.419668 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:26.422138 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.422621 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.423057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.423773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.424229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.424653 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.461036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:26.462182 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:26.468347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.468834 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.469272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.469963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.470417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.470851 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.561277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:26.571739 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9fb3db11-ff14-4c0e-b9df-d8c07b0a6bec tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.159174 Sep 09 23:05:26.572329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 200/414] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:26 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:26.578453 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:26.579350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:26.586247 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.587855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.588544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.589697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.590171 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.590791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.624336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:26.634912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:26.636475 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:26.637735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0c14c20-f336-4fea-b475-ed0f4043850a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.180522 Sep 09 23:05:26.638526 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 215/415] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:26 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:26.703752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9fbd3716-a4f8-4a9f-9efd-ef4fd215792e req-e3a86ebf-a759-489c-a6a7-ef867f0dd410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f905f7dd-b5b2-42ab-a9a4-742d480a26a8", "name": "network-vif-plugged", "status": "completed", "tag": "ef102868-6f48-4e8a-8ce3-bb2980127db1"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:26.713568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9fbd3716-a4f8-4a9f-9efd-ef4fd215792e req-e3a86ebf-a759-489c-a6a7-ef867f0dd410 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:26.714046 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9fbd3716-a4f8-4a9f-9efd-ef4fd215792e req-e3a86ebf-a759-489c-a6a7-ef867f0dd410 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:26.714470 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9fbd3716-a4f8-4a9f-9efd-ef4fd215792e req-e3a86ebf-a759-489c-a6a7-ef867f0dd410 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:26.726168 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9fbd3716-a4f8-4a9f-9efd-ef4fd215792e req-e3a86ebf-a759-489c-a6a7-ef867f0dd410 service nova] Creating event network-vif-plugged:ef102868-6f48-4e8a-8ce3-bb2980127db1 for instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 on hv-cinder-85221 Sep 09 23:05:26.735529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9fbd3716-a4f8-4a9f-9efd-ef4fd215792e req-e3a86ebf-a759-489c-a6a7-ef867f0dd410 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035349 Sep 09 23:05:26.736128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 216/416] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:26.752474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:26.761060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53acfeef-3948-4236-87c8-a79fdc26455c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.187498 Sep 09 23:05:26.761631 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 201/417] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:26 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:27.092743 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:27.093361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 5ee743f1-88ac-4570-90da-c9f8a2edc5e2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:27.099406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.099931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.100376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.101062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.101523 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.101958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.114866 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] HTTP exception thrown: Instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 could not be found. Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Request method failure captured: Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 HTTP/1.1 Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8Y8Cm85wEDitvr-VGnnu8_Ydpv8ykWfclIl5B5MX_Or7bjJhlcSLLvh4-uauHFcyL1A49niryoPgPtv6IL2ZouRgXOQ6llG001mBxUW8M6Diw4iZwl-m4IOXgMAjEMySMK3UeKxCA3A_RpmKPSfPY7uUfCb3W_YW3qhml8iN0kuiXo Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 70d39d21d2844c3599629db4abdc1600 Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotTestJSON-761837007 Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:05:27.116493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70d39d21d2844c3599629db4abdc1600"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/70d39d21d2844c3599629db4abdc1600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_70d39d21d2844c3599629db4abdc1600", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70d39d21d2844c3599629db4abdc1600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotTestJSON-761837007 Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 70d39d21d2844c3599629db4abdc1600 Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-761837007 Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotTestJSON-761837007-project Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: cf0dc39479d1435f902e10cb6827f5e4 Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotTestJSON-761837007-project Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 could not be found. Sep 09 23:05:27.117952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '5ee743f1-88ac-4570-90da-c9f8a2edc5e2'} Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 could not be found. Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:05:27.118714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 could not be found. Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 could not be found. Sep 09 23:05:27.119961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:05:27.121124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Returning 404 to user: Instance 5ee743f1-88ac-4570-90da-c9f8a2edc5e2 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:05:27.121124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d97b9125-37a7-4745-998f-0ef3ba705bdc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2" status: 404 len: 111 microversion: 2.1 time: 0.029531 Sep 09 23:05:27.121124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 217/418] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:27 2022] GET /compute/v2.1/servers/5ee743f1-88ac-4570-90da-c9f8a2edc5e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:05:27.320304 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:27.321777 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:27.328693 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.329224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.329713 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.330495 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.330944 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.331408 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.580376 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:27.589225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96ad0e29-d32c-48bb-9387-62e38b019f83 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.273020 Sep 09 23:05:27.594065 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 202/419] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:27 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:27.595412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:27.596048 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:27.602880 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.603736 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.604417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.605203 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.605726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.606214 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.663451 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:27.664173 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:27.677168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.677168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.677168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.677168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.677866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.677866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.751533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:27.760855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1934f484-fd2a-41ee-ab26-b2f7aad3e968 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.168938 Sep 09 23:05:27.761901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 218/420] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:27 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:27.784081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:27.784913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:27.791265 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.792160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.792699 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.796042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:27.796042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:27.796042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:27.838391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:27.847665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:27.849108 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:27.850276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f05981e-419e-4c47-ad38-d0f0424bb2bd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.191969 Sep 09 23:05:27.851012 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 203/421] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:27 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:27.944657 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:27.952360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fafa935b-6ad0-4978-952a-a3b224f74ff4 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.172208 Sep 09 23:05:27.952907 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 219/422] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:27 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:28.612294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:28.612911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:28.619238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:28.619756 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:28.620195 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:28.620883 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:28.621336 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:28.621783 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:28.747254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:28.754827 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2df0b526-c1bf-461f-8a8a-6b27455b6bde tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.146479 Sep 09 23:05:28.755385 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 204/423] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:28 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:28.783994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:28.784635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:28.790971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:28.791444 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:28.791958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:28.792638 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:28.793085 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:28.793505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:28.877359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:28.878008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:28.884676 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:28.885192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:28.885627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:28.886327 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:28.886789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:28.887215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:28.926078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:28.934674 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b52e997-6698-4eb5-b841-e7adab050388 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.154403 Sep 09 23:05:28.935259 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 220/424] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:28 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:28.975170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:28.975827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:28.981735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:28.982226 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:28.982667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:28.983362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:28.983852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:28.984278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:29.026566 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:29.035295 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:29.036778 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:29.037967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17c40a9c-6066-4ec3-9de5-d7c33da7e9e9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.164658 Sep 09 23:05:29.038522 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 205/425] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:28 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:29.113033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:29.120764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26436246-0f46-431b-935e-324d1d1c837f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.149349 Sep 09 23:05:29.121386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 221/426] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:28 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:29.777966 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:29.778575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:29.784579 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:29.785003 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:29.785438 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:29.786121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:29.786576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:29.787005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:29.912762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:29.920351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46a61a1c-5520-4eb8-8f87-24a60f84009a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.146310 Sep 09 23:05:29.920912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 206/427] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:29 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:29.957996 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:29.958608 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:29.965052 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:29.965538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:29.965973 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:29.966670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:29.967130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:29.967587 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:30.063969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:30.064574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:30.070879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:30.071355 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:30.071819 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:30.072510 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:30.072957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:30.073375 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:30.100328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:30.108630 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63ab41c4-24a1-4fee-925b-4002f61d7947 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.154492 Sep 09 23:05:30.109200 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 222/428] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:29 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:30.143171 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:30.143811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:30.149640 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:30.150127 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:30.150563 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:30.151250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:30.151738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:30.152163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:30.205853 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:30.214596 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:30.216178 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:30.217433 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44335cf3-2ab9-4847-818d-829332ffcce1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.157603 Sep 09 23:05:30.218225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 207/429] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:30 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:30.284361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:30.292579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c08c700-981b-442c-b861-ea0349d8c479 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1265 microversion: 2.1 time: 0.153156 Sep 09 23:05:30.293142 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 223/430] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:30 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:30.943595 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:30.944229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:30.950640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:30.951060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:30.951504 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:30.952207 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:30.952659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:30.953173 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.092816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:31.100470 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-615304d7-e528-4c55-8467-aa84369b9790 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.160648 Sep 09 23:05:31.103525 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 208/431] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:30 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:31.131354 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:31.131979 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:31.138904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:31.139392 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:31.139877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.140574 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:31.141031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:31.141459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.243126 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:31.243916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:31.249952 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:31.250427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:31.250852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.251592 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:31.252049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:31.252469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.269262 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:31.277116 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a526883-7783-4762-8fe8-20229cf09358 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.149609 Sep 09 23:05:31.277716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 224/432] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:31 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:31.315256 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:31.315907 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:31.322385 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:31.322873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:31.323314 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.324035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:31.324579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:31.324925 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.386431 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:31.388747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:31.396352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:31.397803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:31.399091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7acf619f-c86a-4ba5-84d6-25fd80fd7146 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.160753 Sep 09 23:05:31.399764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 209/433] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:31 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:31.470689 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:31.478888 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47a48712-aecd-4fc8-9d19-c4da86c7b785 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1452 microversion: 2.1 time: 0.167530 Sep 09 23:05:31.479779 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 225/434] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:31 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:31.501805 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:31.502446 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:31.509939 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:31.510498 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:31.511001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.511820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:31.512372 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:31.512864 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:31.660258 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:31.668627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30a8c364-fa11-4ab4-9529-da84f2a158b5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1452 microversion: 2.1 time: 0.170785 Sep 09 23:05:31.669204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 210/435] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:31 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:32.124069 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:32.124774 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:32.130878 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:32.131728 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:32.132351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:32.132569 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:32.132941 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:32.134692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:32.276359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:32.285171 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11a05dae-c2df-48e9-8746-f4e0a26eb03e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.166107 Sep 09 23:05:32.285897 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 226/436] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:32 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:32.306006 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:32.307453 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:32.318506 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:32.324817 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:32.325528 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:32.327059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:32.327985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:32.328592 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:32.329170 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:32.425632 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:32.426470 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:32.434905 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:32.438130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:32.438628 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:32.439361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:32.440021 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:32.440896 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:32.446417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:32.625763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:32.634801 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:32.637090 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:32.639159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-08a17549-6f21-46c4-9891-52ea0c971b79 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.217494 Sep 09 23:05:32.640285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 227/437] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:32 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:32.758190 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:32.770381 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f317caf-3230-4f17-ab55-1fef091c3554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1369 microversion: 2.1 time: 0.470651 Sep 09 23:05:32.785701 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 211/438] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:32 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1369 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:33.188592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-42c18f68-9421-4eed-91b0-2e4ac6264cb2 req-c5a28e93-f9e4-40c5-9c5f-236781ab25c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62121a3-5749-4ac2-887a-4eb11c33363f", "name": "network-vif-plugged", "status": "completed", "tag": "f19a26dd-ed5c-4abb-8b1b-6ec798d9c3a6"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:33.219616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-42c18f68-9421-4eed-91b0-2e4ac6264cb2 req-c5a28e93-f9e4-40c5-9c5f-236781ab25c0 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:33.220351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-42c18f68-9421-4eed-91b0-2e4ac6264cb2 req-c5a28e93-f9e4-40c5-9c5f-236781ab25c0 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:33.221785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-42c18f68-9421-4eed-91b0-2e4ac6264cb2 req-c5a28e93-f9e4-40c5-9c5f-236781ab25c0 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:33.252032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-42c18f68-9421-4eed-91b0-2e4ac6264cb2 req-c5a28e93-f9e4-40c5-9c5f-236781ab25c0 service nova] Creating event network-vif-plugged:f19a26dd-ed5c-4abb-8b1b-6ec798d9c3a6 for instance d62121a3-5749-4ac2-887a-4eb11c33363f on hv-cinder-85221 Sep 09 23:05:33.275378 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-42c18f68-9421-4eed-91b0-2e4ac6264cb2 req-c5a28e93-f9e4-40c5-9c5f-236781ab25c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090478 Sep 09 23:05:33.276073 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 228/439] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:33.311448 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:33.312382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:33.324201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:33.324980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:33.325674 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:33.326824 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:33.327715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:33.328499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:33.666353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:33.670605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:33.672058 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:33.681848 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da0a35a3-758f-4e9f-b4d7-322bdfb1efa2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.373442 Sep 09 23:05:33.683723 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:33.684598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 212/440] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:33 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:33.699681 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:33.700224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:33.702904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:33.703518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:33.703948 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:33.798979 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:33.799788 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:33.816928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:33.823037 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:33.823783 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:33.828689 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:33.829370 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:33.829977 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:34.152370 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:34.160270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-874f3178-1aab-41d3-bd4c-421177127483 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1562 microversion: 2.1 time: 0.365773 Sep 09 23:05:34.161256 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:34.167091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 213/441] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:33 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1562 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:34.193283 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:34.194238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:34.194651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:34.198201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:34.202224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-411e9f2e-cd76-40c1-b516-bccfbeb3756b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.535800 Sep 09 23:05:34.202703 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:34.203205 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:34.203665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:34.216224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:34.217093 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:34.217804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:34.221535 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 229/442] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:33 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:34.657648 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7548ba47-4e34-47e5-86f4-4b292f24f538 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.468874 Sep 09 23:05:34.658809 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 214/443] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 23:05:34 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-interface => generated 284 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:34.709412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:34.710446 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:34.718132 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:34.725186 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:34.725667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:34.726415 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:34.726907 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:34.727539 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:34.961150 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:34.970125 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f594e10a-33fa-43b2-bef8-93c58af5d2df tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.264754 Sep 09 23:05:34.971193 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 230/444] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:34 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:35.230795 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:35.232142 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:35.244974 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:35.252287 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:35.253012 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:35.254114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:35.259168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:35.259649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:35.448914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c1d37ea4-193d-4e9f-b347-df68296b3a29 req-50d28848-c716-492b-9477-dc91334bc605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f3832e-f300-4e35-b871-2f2c9dc4cc83", "tag": "26a50981-3889-47e3-800b-120dfa1971a2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:35.482028 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c1d37ea4-193d-4e9f-b347-df68296b3a29 req-50d28848-c716-492b-9477-dc91334bc605 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:35.483019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c1d37ea4-193d-4e9f-b347-df68296b3a29 req-50d28848-c716-492b-9477-dc91334bc605 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:35.486234 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c1d37ea4-193d-4e9f-b347-df68296b3a29 req-50d28848-c716-492b-9477-dc91334bc605 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:35.514371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c1d37ea4-193d-4e9f-b347-df68296b3a29 req-50d28848-c716-492b-9477-dc91334bc605 service nova] Creating event network-changed:26a50981-3889-47e3-800b-120dfa1971a2 for instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 on hv-cinder-85221 Sep 09 23:05:35.538043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c1d37ea4-193d-4e9f-b347-df68296b3a29 req-50d28848-c716-492b-9477-dc91334bc605 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092609 Sep 09 23:05:35.553857 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 231/445] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:35.813977 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:35.826918 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:35.828901 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:35.832935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b14f1cff-2e8e-4545-95ef-5f74600ff7cb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.606578 Sep 09 23:05:35.835054 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 215/446] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:35 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:35.999365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:36.000436 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:36.007515 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:36.008791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:36.009387 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:36.010737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:36.011439 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:36.012318 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:36.233053 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:36.241583 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b4359c06-036e-47fa-9178-f33a60d57472 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.251755 Sep 09 23:05:36.244855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 232/447] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:35 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:36.865246 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:36.866484 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:36.888671 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:36.889486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:36.890104 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:36.890988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:36.891669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:36.892258 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:37.250507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:37.263989 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:37.265712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:37.267184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bfab72d-8cdc-467b-acbf-763f8ad20407 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.407076 Sep 09 23:05:37.272600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:37.274885 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:37.283712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 216/448] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:36 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:37.293102 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:37.293998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:37.294748 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:37.297441 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:37.299322 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:37.299987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:37.497928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1338882243", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "networks": [{"uuid": "c9f00784-ff32-4a59-9d7d-8b6943f7e4e5"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:37.565156 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:37.575657 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9546656d-e9e9-4b57-8cd6-9155f746d316 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.306930 Sep 09 23:05:37.593465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 233/449] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:37 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:37.651513 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] validate_networks() for [('c9f00784-ff32-4a59-9d7d-8b6943f7e4e5', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:05:37.682859 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2c72013d-a8a3-4914-83e1-05ba63cc2b41 req-a774774f-ad0f-420d-8af6-46559b7f6299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f905f7dd-b5b2-42ab-a9a4-742d480a26a8", "tag": "ef102868-6f48-4e8a-8ce3-bb2980127db1"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:37.710427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2c72013d-a8a3-4914-83e1-05ba63cc2b41 req-a774774f-ad0f-420d-8af6-46559b7f6299 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:37.734479 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2c72013d-a8a3-4914-83e1-05ba63cc2b41 req-a774774f-ad0f-420d-8af6-46559b7f6299 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:37.735014 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2c72013d-a8a3-4914-83e1-05ba63cc2b41 req-a774774f-ad0f-420d-8af6-46559b7f6299 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:37.763807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2c72013d-a8a3-4914-83e1-05ba63cc2b41 req-a774774f-ad0f-420d-8af6-46559b7f6299 service nova] Creating event network-changed:ef102868-6f48-4e8a-8ce3-bb2980127db1 for instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 on hv-cinder-85221 Sep 09 23:05:37.772631 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2c72013d-a8a3-4914-83e1-05ba63cc2b41 req-a774774f-ad0f-420d-8af6-46559b7f6299 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095001 Sep 09 23:05:37.773250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 234/450] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:05:38.297468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:38.299078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:38.321278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:38.322162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:38.322916 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:38.323934 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:38.324616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:38.325264 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:38.346781 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:05:38.347382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:05:38.347693 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:05:38.348264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:05:38.348674 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:05:38.360876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:38.361808 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:38.363338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:38.364584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:38.365225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:38.365930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:38.386162 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Getting quotas for project 70d39d21d2844c3599629db4abdc1600. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:05:38.390987 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Getting quotas for user cf0dc39479d1435f902e10cb6827f5e4 and project 70d39d21d2844c3599629db4abdc1600. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:05:38.404041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:05:38.406734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:05:38.461434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-84421fb9-301f-4ec7-8037-d6b17fb6fdcc tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969659 Sep 09 23:05:38.462956 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 217/451] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:05:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:05:38.474864 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4818483-a334-4cb4-adbb-63443cf79014 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:38.480342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4818483-a334-4cb4-adbb-63443cf79014 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:38.615556 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4818483-a334-4cb4-adbb-63443cf79014 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:38.628496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4818483-a334-4cb4-adbb-63443cf79014 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1219 microversion: 2.1 time: 0.157529 Sep 09 23:05:38.629284 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 218/452] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:38 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:38.634512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:38.635448 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:38.651323 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:38.652716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:38.654728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:38.655409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:38.657331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:38.659088 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:38.661395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:38.665418 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:38.667696 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:38.669143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-083a0942-00f1-4e33-a539-be7aa013e94d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.376446 Sep 09 23:05:38.670210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 235/453] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:38 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:38.869877 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:38.881483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9cdf04e9-fb0b-4d78-b7dc-c15da7f581e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.250786 Sep 09 23:05:38.882628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 219/454] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:38 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:39.650644 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:39.651313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:39.671445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:39.673225 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:39.673670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:39.674379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:39.675033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:39.675460 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:39.699082 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:39.700409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:39.707905 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:39.708724 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:39.709353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:39.710239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:39.719001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:39.719814 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:39.775717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:39.784321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c30b2f6-3edc-4d7f-93c2-c9935ebebdfa tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1223 microversion: 2.1 time: 0.137650 Sep 09 23:05:39.785220 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 236/455] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:39 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:39.876652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:39.886656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:39.888050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:39.889285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4023e7e-ec62-4ffa-b7d0-04d6b98f94d3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.194741 Sep 09 23:05:39.889850 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 220/456] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:39 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:39.921846 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:39.922469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:39.929730 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:39.931176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:39.931659 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:39.932386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:39.932846 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:39.933276 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:40.076805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:40.084484 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-66f8327c-c26a-4636-8e64-2e8981d23d6f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.180780 Sep 09 23:05:40.085047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 237/457] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:39 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:40.809205 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:40.810109 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:40.819981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:40.822367 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:40.824371 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:40.825220 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:40.827778 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:40.828329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:40.919791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:40.919791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:40.920469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:40.927142 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:40.927281 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:40.928217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7470fdcd-2b10-4cc8-9270-979185e265a5 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1223 microversion: 2.1 time: 0.124557 Sep 09 23:05:40.928347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:40.928758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 221/458] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:40 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:40.943896 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:40.944960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:40.946566 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:41.089217 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:41.098421 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:41.099976 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:41.102050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e40f2039-ba92-41eb-9de7-610bb8c623ef tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.189569 Sep 09 23:05:41.103149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 238/459] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:40 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:41.107831 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:41.108522 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:41.114558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:41.115285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:41.115958 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:41.116888 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:41.118040 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:41.118660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:41.263455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:41.271181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bf0337f-d8ee-4c6d-9368-e2b7b42223b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.167210 Sep 09 23:05:41.271920 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 222/460] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:41 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:41.952543 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:41.953155 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:41.959641 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:41.960193 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:41.960685 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:41.961962 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:41.962416 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:41.962840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:42.025635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:42.033333 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5b8653b-3794-438a-a85b-adeb00f47fc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1223 microversion: 2.1 time: 0.084589 Sep 09 23:05:42.034222 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 239/461] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:41 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:42.127813 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:42.128458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:42.135387 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:42.135937 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:42.136379 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:42.137077 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:42.137544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:42.137971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:42.274326 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:42.282842 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:42.284303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:42.285461 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f2e2baf-144e-4c4e-92cb-2db4ca91822a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.161675 Sep 09 23:05:42.286057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 223/462] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:42 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:42.295201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:42.295841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:42.301818 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:42.302307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:42.303033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:42.303761 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:42.304212 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:42.304638 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:42.445081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:42.454417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5e4c385-a00b-4418-a420-f0f157a40619 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.162961 Sep 09 23:05:42.455004 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 240/463] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:42 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:43.056344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:43.056949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:43.062841 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:43.063316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:43.063781 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:43.064467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:43.064932 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:43.065338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:43.127218 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:43.135895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd0dd0c5-d714-40ea-a84d-0e7a044cb947 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1223 microversion: 2.1 time: 0.083579 Sep 09 23:05:43.136496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 224/464] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:43 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:43.311968 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:43.313240 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:43.321902 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:43.322443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:43.322875 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:43.323635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:43.326060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:43.326687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:43.480231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:43.481311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:43.491331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:43.492851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:43.493608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:43.494529 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:43.495145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:43.496746 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:43.534972 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:43.550646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:43.552263 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:43.553767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a20f8c68-e4b1-4d1d-9e78-ef36b783b6f7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.245884 Sep 09 23:05:43.554315 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 241/465] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:43 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:43.891288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:43.899423 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-09a95f94-8ae8-42c5-bb8b-5269138ad365 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.423598 Sep 09 23:05:43.900037 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 225/466] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:43 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:44.158061 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:44.158785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:44.166436 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:44.167062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:44.168337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:44.168811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:44.169580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:44.170181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:44.236454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:44.244288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-801b6d81-1535-436c-ab6c-1e7bc603c7e0 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1271 microversion: 2.1 time: 0.090023 Sep 09 23:05:44.245128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 242/467] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:44 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:44.579639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:44.580354 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:44.587397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:44.588011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:44.588592 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:44.589402 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:44.589947 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:44.590405 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:44.922368 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:44.922977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:44.926420 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:44.931223 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:44.931734 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:44.932168 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:44.932657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:44.932857 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:44.933305 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:44.933726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:44.941442 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:44.942866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:44.944046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d696ffa9-acb7-464a-906a-8182b127c751 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.368393 Sep 09 23:05:44.944610 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 226/468] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:44 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:45.088491 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:45.099726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1ec1cba-0329-4a4e-a5e6-37893b936716 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1368 microversion: 2.1 time: 0.181262 Sep 09 23:05:45.100914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 243/469] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:44 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:45.267834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:45.268560 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:45.275001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:45.275477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:45.275941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:45.276627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:45.277081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:45.277499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:45.345763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:45.353965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a84ae1ff-f4eb-4165-abcb-9ccc8b29c937 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1271 microversion: 2.1 time: 0.090271 Sep 09 23:05:45.354521 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 227/470] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:45 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:45.969876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:45.970487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:45.976965 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:45.977445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:45.977881 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:45.978565 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:45.979027 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:45.979447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:46.110436 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:46.119513 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:46.120984 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:46.122191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1601a585-8a1c-40de-ae7d-a4f33c583ec1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.156303 Sep 09 23:05:46.122752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 244/471] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:45 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:46.124182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:46.124865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:46.131156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:46.131747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:46.132247 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:46.133629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:46.134083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:46.134507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:46.150870 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:46.267471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:46.276036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-640db146-73c8-4df3-b374-c03bcaccadf5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1558 microversion: 2.1 time: 0.156165 Sep 09 23:05:46.276650 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 228/472] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:46 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:46.298057 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:46.298546 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:46.305380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:46.305856 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:46.306338 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:46.306968 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:46.307419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:46.307868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:46.376734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:46.377466 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:46.383964 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:46.384128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-435e0ccf-ad35-4cc8-a8b1-9e98c1d6e808 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089166 Sep 09 23:05:46.384443 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:46.384694 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 245/473] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 23:05:46 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:46.384938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:46.385702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:46.386161 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:46.386584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:46.448117 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:46.455678 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9d3bd89f-4125-459e-8ad0-fed604c1807a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1271 microversion: 2.1 time: 0.082689 Sep 09 23:05:46.456242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 229/474] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:46 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:47.149320 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:47.149918 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:47.155746 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:47.156230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:47.156660 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:47.157343 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:47.157820 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:47.158243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:47.162141 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:47.381112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:47.393639 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:47.395126 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5ea46c1d-3e0b-456c-86f6-345e984fc5bb req-238209d5-d19d-47cb-aedd-7fa238d2972e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62121a3-5749-4ac2-887a-4eb11c33363f", "tag": "f19a26dd-ed5c-4abb-8b1b-6ec798d9c3a6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:47.395757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:47.396529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a22046fa-80c2-4a0b-8ac7-b5c3a46bda50 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.252413 Sep 09 23:05:47.397106 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 246/475] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:47 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:47.406219 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5ea46c1d-3e0b-456c-86f6-345e984fc5bb req-238209d5-d19d-47cb-aedd-7fa238d2972e service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:47.406403 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5ea46c1d-3e0b-456c-86f6-345e984fc5bb req-238209d5-d19d-47cb-aedd-7fa238d2972e service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:47.406772 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5ea46c1d-3e0b-456c-86f6-345e984fc5bb req-238209d5-d19d-47cb-aedd-7fa238d2972e service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:47.418118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5ea46c1d-3e0b-456c-86f6-345e984fc5bb req-238209d5-d19d-47cb-aedd-7fa238d2972e service nova] Creating event network-changed:f19a26dd-ed5c-4abb-8b1b-6ec798d9c3a6 for instance d62121a3-5749-4ac2-887a-4eb11c33363f on hv-cinder-85221 Sep 09 23:05:47.423151 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5ea46c1d-3e0b-456c-86f6-345e984fc5bb req-238209d5-d19d-47cb-aedd-7fa238d2972e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031637 Sep 09 23:05:47.424176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 230/476] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:05:47.478218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:47.478827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:47.484682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:47.485165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:47.485599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:47.486287 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:47.486742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:47.487163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:47.547881 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:47.555744 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-349711cb-651e-4400-a0a0-d4b5295c6c61 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1271 microversion: 2.1 time: 0.081376 Sep 09 23:05:47.556315 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 247/477] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:47 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:48.418842 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:48.423514 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:48.424214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:48.430792 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:48.431268 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:48.431747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:48.432425 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:48.432873 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:48.433294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:48.567046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:48.575960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:48.577415 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:48.578560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:48.579046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efb50e07-d06c-40eb-bf72-44e03cf65657 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.160813 Sep 09 23:05:48.579156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 231/478] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:48 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:48.579240 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:48.585478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:48.586445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:48.586876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:48.587581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:48.588032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:48.588449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:48.651756 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:48.659373 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29ac80eb-6a97-464a-90cf-f122eb2e5760 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1271 microversion: 2.1 time: 0.084734 Sep 09 23:05:48.659968 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 248/479] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:48 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:49.604523 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:49.605161 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:49.606944 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:05:49.612499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:49.612983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:49.613418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:49.614103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:49.614556 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:49.614983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:49.683147 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:49.683883 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:49.690643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:49.691128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:49.691588 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:49.692288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:49.693012 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:49.693209 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:49.748879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:49.754996 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:49.757582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:49.759103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:49.760398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95724cd6-f795-47d6-be58-1f9c2b530ca4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.160297 Sep 09 23:05:49.761068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 232/480] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:49 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:49.762580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77dd20b0-3b02-44bb-a683-d770dd51cb17 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1271 microversion: 2.1 time: 0.084043 Sep 09 23:05:49.763129 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 249/481] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:49 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:50.785559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:50.786969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:50.787535 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:50.788018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:50.796125 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:50.796917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:50.797521 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:50.797805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:50.798725 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:50.799389 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:50.800162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:50.808544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:50.810950 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:50.811788 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:50.813206 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:50.813874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:50.977074 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:50.987102 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:50.989395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:50.991088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b9b4ea9-0693-4b22-b519-7bc746b016c6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.209168 Sep 09 23:05:50.992856 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 250/482] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:50 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:51.017660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:51.034471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-43d74877-aabe-42aa-9a3e-1e4244acf66a tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1279 microversion: 2.1 time: 0.252660 Sep 09 23:05:51.035640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 233/483] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:50 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1279 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:05:52.018298 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:52.018892 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:52.025985 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:52.026465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:52.026915 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:52.027606 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:52.028058 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:52.028477 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:52.063471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:52.064103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:52.071281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:52.072031 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:52.072474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:52.073179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:52.073635 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:52.074235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:52.170490 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:52.181970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:52.183515 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:52.184824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c836df79-c246-4e43-86d7-6e8282fdb827 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.170546 Sep 09 23:05:52.185837 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 251/484] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:52 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:52.288456 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:52.296527 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f805fcd-8786-40c5-b9af-fcb86a854e73 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.236888 Sep 09 23:05:52.297102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 234/485] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:52 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:52.880455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3383b578-8073-434f-9603-dd53266659f0 req-00312893-181a-45a4-95aa-8c0ec12586bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a61066-ede0-4187-950d-924d17193c85", "tag": "3cdf41ca-ffe1-47e1-896f-4fbb47a7eddc"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:52.902791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3383b578-8073-434f-9603-dd53266659f0 req-00312893-181a-45a4-95aa-8c0ec12586bc service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:52.903560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3383b578-8073-434f-9603-dd53266659f0 req-00312893-181a-45a4-95aa-8c0ec12586bc service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:52.904162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3383b578-8073-434f-9603-dd53266659f0 req-00312893-181a-45a4-95aa-8c0ec12586bc service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:52.920074 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3383b578-8073-434f-9603-dd53266659f0 req-00312893-181a-45a4-95aa-8c0ec12586bc service nova] Creating event network-changed:3cdf41ca-ffe1-47e1-896f-4fbb47a7eddc for instance 26a61066-ede0-4187-950d-924d17193c85 on hv-cinder-85221 Sep 09 23:05:52.928558 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3383b578-8073-434f-9603-dd53266659f0 req-00312893-181a-45a4-95aa-8c0ec12586bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058417 Sep 09 23:05:52.930164 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 252/486] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:53.033772 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-375f8380-29bd-4425-87f4-048b4fcbe2f8 req-2b90505a-d33e-4d86-a5e0-60da8e17d962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2052a904-5812-447c-b0ac-d3c9dc4321cb", "name": "network-vif-plugged", "status": "completed", "tag": "37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:53.044604 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-375f8380-29bd-4425-87f4-048b4fcbe2f8 req-2b90505a-d33e-4d86-a5e0-60da8e17d962 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:53.044910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-375f8380-29bd-4425-87f4-048b4fcbe2f8 req-2b90505a-d33e-4d86-a5e0-60da8e17d962 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:53.045371 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-375f8380-29bd-4425-87f4-048b4fcbe2f8 req-2b90505a-d33e-4d86-a5e0-60da8e17d962 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:53.059049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-375f8380-29bd-4425-87f4-048b4fcbe2f8 req-2b90505a-d33e-4d86-a5e0-60da8e17d962 service nova] Creating event network-vif-plugged:37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba for instance 2052a904-5812-447c-b0ac-d3c9dc4321cb on hv-cinder-85221 Sep 09 23:05:53.064331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-375f8380-29bd-4425-87f4-048b4fcbe2f8 req-2b90505a-d33e-4d86-a5e0-60da8e17d962 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034251 Sep 09 23:05:53.065147 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 235/487] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:53.213042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:53.213741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:53.221230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:53.221720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:53.222151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:53.222848 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:53.223300 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:53.223767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:53.322515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:53.323303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:53.329461 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:53.329951 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:53.330540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:53.331199 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:53.331889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:53.332536 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:53.356674 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:53.366474 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:53.368002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:53.369158 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-024b6d4c-948b-419e-842b-87affb151b56 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.161885 Sep 09 23:05:53.369717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 253/488] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:53 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:53.470508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:53.478055 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b15ab32a-764b-4e89-83f1-f981ba41d93d tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.161028 Sep 09 23:05:53.478608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 236/489] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:53 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:54.394284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:54.395400 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:54.411907 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:54.411907 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:54.411907 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:54.411907 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:54.412542 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:54.412542 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:54.500574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:54.501184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:54.508277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:54.508757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:54.509186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:54.509877 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:54.510322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:54.510755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:54.540488 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:54.549570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:54.551452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:54.552368 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02c76fb2-049e-4a40-8563-218eb1fa40ce tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.162164 Sep 09 23:05:54.553285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 254/490] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:54 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:54.653379 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:54.661384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1974134f-122b-4510-bdbf-31c6346974e7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.164629 Sep 09 23:05:54.661943 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 237/491] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:54 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:55.577663 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:55.578277 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:55.584562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:55.585039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:55.585476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:55.586161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:55.586615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:55.587038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:55.685095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:55.685762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:55.692349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:55.693128 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:55.693751 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:55.694465 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:55.694916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:55.695341 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:55.719906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:55.729299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:55.730750 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:55.731982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ec0cfad-9758-45de-b2d3-55c20652dcad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.158187 Sep 09 23:05:55.732719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 255/492] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:55 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:55.826792 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:55.834278 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77bc4db8-9965-47bb-957e-aa89d23c71fe tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.153765 Sep 09 23:05:55.834840 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 238/493] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:55 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:56.757617 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:56.758283 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:56.765326 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:56.765806 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:56.766237 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:56.766919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:56.767365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:56.767830 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:56.856828 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:56.857438 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:56.864910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:56.865408 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:56.865849 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:56.866551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:56.867007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:56.867651 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:56.900066 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:56.909232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:56.910967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:56.912313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed08dbf9-cc0c-45fa-a6b0-0a2d5a6a4d31 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.158544 Sep 09 23:05:56.912959 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 256/494] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:56 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:57.008236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:57.016004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bb495f0-0aaa-4a38-9d32-8ee2d727ec25 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.162970 Sep 09 23:05:57.016572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 239/495] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:56 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:57.939860 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:57.940401 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:57.947431 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:57.948002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:57.948510 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:57.949276 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:57.949735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:57.950164 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:58.038030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:58.038647 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:58.044916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:58.045655 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:58.046092 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:58.046962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:58.047421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:58.047875 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:58.092198 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:58.101137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:58.102582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:58.103768 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ce3a1bb-0df6-4d21-8db1-061bb340c854 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1809 microversion: 2.20 time: 0.168336 Sep 09 23:05:58.104328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 257/496] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:57 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:05:58.183832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:58.194061 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34fd6e29-8bca-4ba3-93c0-814fc16fcb94 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.159558 Sep 09 23:05:58.199524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 240/497] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:58 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:05:59.026584 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e74ae667-5e66-402b-b456-31e93463bd6d req-83cbffd8-ce45-4264-b9cc-c97b08d3d6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a61066-ede0-4187-950d-924d17193c85", "name": "network-vif-plugged", "status": "completed", "tag": "3cdf41ca-ffe1-47e1-896f-4fbb47a7eddc"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:05:59.037030 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e74ae667-5e66-402b-b456-31e93463bd6d req-83cbffd8-ce45-4264-b9cc-c97b08d3d6d1 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:59.037553 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e74ae667-5e66-402b-b456-31e93463bd6d req-83cbffd8-ce45-4264-b9cc-c97b08d3d6d1 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:59.038121 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e74ae667-5e66-402b-b456-31e93463bd6d req-83cbffd8-ce45-4264-b9cc-c97b08d3d6d1 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:59.051910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e74ae667-5e66-402b-b456-31e93463bd6d req-83cbffd8-ce45-4264-b9cc-c97b08d3d6d1 service nova] Creating event network-vif-plugged:3cdf41ca-ffe1-47e1-896f-4fbb47a7eddc for instance 26a61066-ede0-4187-950d-924d17193c85 on hv-cinder-85221 Sep 09 23:05:59.056881 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e74ae667-5e66-402b-b456-31e93463bd6d req-83cbffd8-ce45-4264-b9cc-c97b08d3d6d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034527 Sep 09 23:05:59.057697 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 258/498] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:05:59.129895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:59.130450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:59.136574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:59.137090 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:59.137582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:59.138276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:59.138745 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:59.139160 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:59.219801 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:05:59.220957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:05:59.228330 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:59.228896 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:59.229427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:59.230340 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:05:59.230871 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:05:59.231453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:05:59.284895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:59.293610 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:59.295591 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:59.296252 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffe342cf-aba3-4e7e-85b6-f9baed5b846b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1796 microversion: 2.20 time: 0.170584 Sep 09 23:05:59.299623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 241/499] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:05:59 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1796 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:05:59.372428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:05:59.379979 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8899a1f7-4c91-47b9-b162-59212e870dc1 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.164634 Sep 09 23:05:59.380478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 259/500] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:05:59 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:06:00.404356 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:00.404993 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:00.411501 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:00.412022 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:00.412453 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:00.413165 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:00.413619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:00.414039 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:00.546285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:00.554056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4785b53b-04db-42f7-a261-29266a71684c tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.153541 Sep 09 23:06:00.554615 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 242/501] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:00 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:01.577096 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:01.577711 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:01.584354 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:01.584839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:01.585276 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:01.585967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:01.586426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:01.587513 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:01.721490 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:01.729170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ff29ac5-e4a4-4ea0-878a-7649678e9d79 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1319 microversion: 2.1 time: 0.155944 Sep 09 23:06:01.729910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 260/502] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:01 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:02.752244 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:02.752850 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:02.755708 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:02.760969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:02.761450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:02.761882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:02.762571 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:02.763025 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:02.763451 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:02.893667 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:02.901268 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-69761efc-2392-4089-af6c-c034ed484ecf tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1508 microversion: 2.1 time: 0.152990 Sep 09 23:06:02.902324 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 243/503] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:02 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:02.924437 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b87d9896-b7e7-4ae0-8a88-0cd75c394d75", "device": "/dev/sdb"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:06:02.927363 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:02.934096 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:02.934572 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:02.934997 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:02.935706 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:02.936159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:02.936575 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:03.215789 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-942f64eb-c71d-4038-a6f6-7aea9950a0d2 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "POST /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293762 Sep 09 23:06:03.216398 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 261/504] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:06:02 2022] POST /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:06:23.595664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:23.596237 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:23.598860 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:23.599530 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=85 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:23.608159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:23.608658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:23.609101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:23.609805 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:23.610265 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:23.610692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:23.744661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lazy-loading 'services' on Instance uuid 26a61066-ede0-4187-950d-924d17193c85 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:06:23.862947 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83947336-7dec-400e-9958-a30ac8b63d2b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85/os-volume_attachments/b87d9896-b7e7-4ae0-8a88-0cd75c394d75" status: 202 len: 0 microversion: 2.1 time: 0.273163 Sep 09 23:06:23.863587 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 244/505] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:06:23 2022] DELETE /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85/os-volume_attachments/b87d9896-b7e7-4ae0-8a88-0cd75c394d75 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:06:26.044146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:26.044725 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:26.048100 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=36 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:26.048764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:26.054924 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:26.055404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:26.055861 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:26.056548 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:26.057004 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:26.057432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:26.082860 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:06:26.157485 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-813a235f-b230-45dd-9d54-9dfbebc251a7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 204 len: 0 microversion: 2.1 time: 0.117192 Sep 09 23:06:26.158610 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 262/506] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:06:26 2022] DELETE /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:06:26.170201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:26.170905 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:26.177171 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:26.177661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:26.178350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:26.179038 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:26.179511 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:26.179939 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:26.316034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:26.323577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5b6697c-0cb5-4f4c-bea8-d1bf2a1fa19b tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1514 microversion: 2.1 time: 0.160348 Sep 09 23:06:26.324141 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 245/507] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:26 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:27.347849 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:27.348600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:27.355133 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:27.355667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:27.356133 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:27.356831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:27.357913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:27.358353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:27.486264 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:27.493784 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1749612a-5412-4386-9649-34bd9a8a7de7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1514 microversion: 2.1 time: 0.150245 Sep 09 23:06:27.494340 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 263/508] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:27 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:28.516452 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:28.517098 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:28.523458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:28.523976 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:28.524404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:28.525091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:28.525566 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:28.525985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:28.716366 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc39479d1435f902e10cb6827f5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d39d21d2844c3599629db4abdc1600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:28.725079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-26325753-d355-4c90-818b-291e7e498ea9 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 200 len: 1514 microversion: 2.1 time: 0.212353 Sep 09 23:06:28.725745 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 246/509] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:28 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:28.834148 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c709d962-6289-4cf8-ac18-771e3eb49831 req-fd0b5a98-c408-4789-b737-1a894111fddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a61066-ede0-4187-950d-924d17193c85", "name": "network-vif-deleted", "tag": "3cdf41ca-ffe1-47e1-896f-4fbb47a7eddc"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:06:28.845312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c709d962-6289-4cf8-ac18-771e3eb49831 req-fd0b5a98-c408-4789-b737-1a894111fddb service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:28.846092 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c709d962-6289-4cf8-ac18-771e3eb49831 req-fd0b5a98-c408-4789-b737-1a894111fddb service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:28.846563 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c709d962-6289-4cf8-ac18-771e3eb49831 req-fd0b5a98-c408-4789-b737-1a894111fddb service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:28.860075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c709d962-6289-4cf8-ac18-771e3eb49831 req-fd0b5a98-c408-4789-b737-1a894111fddb service nova] Creating event network-vif-deleted:3cdf41ca-ffe1-47e1-896f-4fbb47a7eddc for instance 26a61066-ede0-4187-950d-924d17193c85 on hv-cinder-85221 Sep 09 23:06:28.865429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c709d962-6289-4cf8-ac18-771e3eb49831 req-fd0b5a98-c408-4789-b737-1a894111fddb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035354 Sep 09 23:06:28.866731 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 264/510] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:06:29.751964 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:29.752581 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] [instance: 26a61066-ede0-4187-950d-924d17193c85] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:29.758532 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:29.759224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:29.759695 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:29.760584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:29.761034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:29.761621 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:29.775817 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] HTTP exception thrown: Instance 26a61066-ede0-4187-950d-924d17193c85 could not be found. Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Request method failure captured: Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 HTTP/1.1 Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8Y8Cm85wEDitvr-VGnnu8_Ydpv8ykWfclIl5B5MX_Or7bjJhlcSLLvh4-uauHFcyL1A49niryoPgPtv6IL2ZouRgXOQ6llG001mBxUW8M6Diw4iZwl-m4IOXgMAjEMySMK3UeKxCA3A_RpmKPSfPY7uUfCb3W_YW3qhml8iN0kuiXo Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 70d39d21d2844c3599629db4abdc1600 Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotTestJSON-761837007 Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:06:29.777486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70d39d21d2844c3599629db4abdc1600"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/70d39d21d2844c3599629db4abdc1600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_70d39d21d2844c3599629db4abdc1600", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/70d39d21d2844c3599629db4abdc1600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotTestJSON-761837007 Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 70d39d21d2844c3599629db4abdc1600 Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-761837007 Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotTestJSON-761837007-project Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: cf0dc39479d1435f902e10cb6827f5e4 Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotTestJSON-761837007-project Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 26a61066-ede0-4187-950d-924d17193c85 could not be found. Sep 09 23:06:29.779106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '26a61066-ede0-4187-950d-924d17193c85'} Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a61066-ede0-4187-950d-924d17193c85 could not be found. Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:06:29.780044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a61066-ede0-4187-950d-924d17193c85 could not be found. Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a61066-ede0-4187-950d-924d17193c85 could not be found. Sep 09 23:06:29.781716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:29.783034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] Returning 404 to user: Instance 26a61066-ede0-4187-950d-924d17193c85 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:06:29.783034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bcd7977-b862-42a5-a7d0-7a4150914dc7 tempest-VolumesSnapshotTestJSON-761837007 tempest-VolumesSnapshotTestJSON-761837007-project] 10.222.0.17 "GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85" status: 404 len: 111 microversion: 2.1 time: 0.031270 Sep 09 23:06:29.783866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 247/511] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:29 2022] GET /compute/v2.1/servers/26a61066-ede0-4187-950d-924d17193c85 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:06:43.642548 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:43.643404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:43.648078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:43.648664 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:43.656864 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:43.657516 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:43.658078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:43.658932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:43.659394 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:43.659849 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:43.686688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-165400de-8750-4141-9c69-c433b64e682a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f/ips" status: 200 len: 150 microversion: 2.1 time: 0.045671 Sep 09 23:06:43.687248 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 265/512] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:06:43 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:06:43.698771 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "313dcb36-a664-4af7-8b18-4f788b317d39"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:06:43.701392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:43.704311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:43.704974 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:43.711397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:43.711913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:43.712355 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:43.713053 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:43.713509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:43.713934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:43.797242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Invalid volume: volume 313dcb36-a664-4af7-8b18-4f788b317d39 is already attached to instances: 04df6bca-4a68-4c7c-a314-ab08a28dfec3 Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f/os-volume_attachments HTTP/1.1 Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 74 Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:06:43.798851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {"volumeAttachment": {"volumeId": "313dcb36-a664-4af7-8b18-4f788b317d39"}} Sep 09 23:06:43.800515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Invalid volume: volume 313dcb36-a664-4af7-8b18-4f788b317d39 is already attached to instances: 04df6bca-4a68-4c7c-a314-ab08a28dfec3 Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'server_id': 'd62121a3-5749-4ac2-887a-4eb11c33363f', 'body': {'volumeAttachment': {'volumeId': '313dcb36-a664-4af7-8b18-4f788b317d39'}}} Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 313dcb36-a664-4af7-8b18-4f788b317d39 is already attached to instances: 04df6bca-4a68-4c7c-a314-ab08a28dfec3 Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:43.801459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 313dcb36-a664-4af7-8b18-4f788b317d39 is already attached to instances: 04df6bca-4a68-4c7c-a314-ab08a28dfec3 Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:43.803159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:06:43.804626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:06:43.804626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:06:43.804626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:06:43.804626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 313dcb36-a664-4af7-8b18-4f788b317d39 is already attached to instances: 04df6bca-4a68-4c7c-a314-ab08a28dfec3 Sep 09 23:06:43.804626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:43.804626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 400 to user: Invalid volume: volume 313dcb36-a664-4af7-8b18-4f788b317d39 is already attached to instances: 04df6bca-4a68-4c7c-a314-ab08a28dfec3 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:06:43.804626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e315512e-cbca-4855-a00e-f21de2a3cb76 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105649 Sep 09 23:06:43.804626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 248/513] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:06:43 2022] POST /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:06:43.810552 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:43.810992 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:43.816841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:43.817320 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:43.817754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:43.818441 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:43.818896 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:43.819321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:43.843542 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:06:43.914136 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18160f80-ba03-4ab9-8eac-727fed8c78e7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 204 len: 0 microversion: 2.1 time: 0.107195 Sep 09 23:06:43.914714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 266/514] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:06:43 2022] DELETE /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 23:06:43.923616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:43.924274 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:43.930789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:43.931263 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:43.931723 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:43.932430 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:43.932885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:43.933302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:44.065663 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:44.073181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42f983fb-e6b1-4ae6-9e44-9eed7d919c14 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1683 microversion: 2.1 time: 0.154128 Sep 09 23:06:44.073731 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 249/515] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:43 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:44.852865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f2a8c95-a2a7-4790-89b4-459ef4868248"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:06:44.855229 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:44.861975 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:44.862450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:44.862915 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:44.863630 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:44.864079 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:44.864495 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:45.095872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:45.096486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:45.102817 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:45.103300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:45.103773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:45.104463 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:45.104922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:45.105420 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:45.236934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:45.244593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88d2e544-cbbd-49d7-9d09-d075651e1851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1683 microversion: 2.1 time: 0.152564 Sep 09 23:06:45.245102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 250/516] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:45 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:06:46.268301 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:46.268917 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:46.275252 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:46.275764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:46.276203 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:46.276913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:46.277367 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:46.277791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:46.408292 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:46.415858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80bcdb2f-48d7-4378-b8f9-f23aec303ebd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1683 microversion: 2.1 time: 0.152021 Sep 09 23:06:46.416449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 251/517] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:46 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:06:47.440240 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:47.440909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:47.447182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:47.447702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:47.448141 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:47.448822 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:47.449274 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:47.449697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:47.588551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:47.596268 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bfc7a108-a3b7-4890-a313-c665475b6c43 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1683 microversion: 2.1 time: 0.160449 Sep 09 23:06:47.596829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 252/518] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:47 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:06:48.613088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f676513f-13bc-428a-bd4a-ad387af8d274 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.764342 Sep 09 23:06:48.619020 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 267/519] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:06:44 2022] POST /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments => generated 194 bytes in 3766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:06:48.619413 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:48.620577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:48.627574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:48.628359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:48.629425 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:48.631015 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:48.631880 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:48.632888 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:48.772394 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:48.780143 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-239de8ad-4ebc-4132-a5d1-f71c11e4e2d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1683 microversion: 2.1 time: 0.164638 Sep 09 23:06:48.780698 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 253/520] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:48 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:49.804345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:49.805228 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:49.813088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:49.813783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:49.814226 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:49.815271 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:49.816238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:49.816343 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:50.135363 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:50.144034 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2056e817-daec-4c7d-8926-8039d4e3ee66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1683 microversion: 2.1 time: 0.344186 Sep 09 23:06:50.145027 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 268/521] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:49 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1683 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:50.259680 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a8047baa-5c62-42d3-bc62-8eb6991fda17 req-c9db617d-4929-4d2d-8651-0a875898c8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62121a3-5749-4ac2-887a-4eb11c33363f", "name": "network-vif-deleted", "tag": "f19a26dd-ed5c-4abb-8b1b-6ec798d9c3a6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:06:50.269666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a8047baa-5c62-42d3-bc62-8eb6991fda17 req-c9db617d-4929-4d2d-8651-0a875898c8b0 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:50.270400 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a8047baa-5c62-42d3-bc62-8eb6991fda17 req-c9db617d-4929-4d2d-8651-0a875898c8b0 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:50.270868 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a8047baa-5c62-42d3-bc62-8eb6991fda17 req-c9db617d-4929-4d2d-8651-0a875898c8b0 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:50.282183 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a8047baa-5c62-42d3-bc62-8eb6991fda17 req-c9db617d-4929-4d2d-8651-0a875898c8b0 service nova] Creating event network-vif-deleted:f19a26dd-ed5c-4abb-8b1b-6ec798d9c3a6 for instance d62121a3-5749-4ac2-887a-4eb11c33363f on hv-cinder-85221 Sep 09 23:06:50.287616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a8047baa-5c62-42d3-bc62-8eb6991fda17 req-c9db617d-4929-4d2d-8651-0a875898c8b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Sep 09 23:06:50.288194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 254/522] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:06:51.170798 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:51.172187 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:51.178914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:51.179784 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:51.180355 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:51.181191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:51.181683 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:51.182108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:51.246675 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:51.255783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc6ba77a-20e8-4545-90e2-d27cc60a21f9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1615 microversion: 2.1 time: 0.088779 Sep 09 23:06:51.261159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 269/523] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:51 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:52.284969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:52.285673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:52.291996 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:52.292482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:52.292919 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:52.293623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:52.294079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:52.294507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:52.358323 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:52.366451 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-510358f4-9dfd-4363-b33e-c06439721a66 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1615 microversion: 2.1 time: 0.086246 Sep 09 23:06:52.367008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 255/524] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:52 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:53.391907 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:53.392524 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:53.398899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:53.399386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:53.399866 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:53.400559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:53.401017 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:53.401447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:53.431869 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:53.432342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:53.432812 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:53.433266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lazy-loading 'fault' on Instance uuid d62121a3-5749-4ac2-887a-4eb11c33363f {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:06:53.473224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:53.480673 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39836a17-7c74-49bf-87b4-3824d584d5b7 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1332 microversion: 2.1 time: 0.093148 Sep 09 23:06:53.481239 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 270/525] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:53 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:54.114071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:06:54.116333 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:54.123161 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:54.123706 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:54.124717 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:54.125495 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:54.125872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:54.126302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:54.151582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lazy-loading 'flavor' on Instance uuid f905f7dd-b5b2-42ab-a9a4-742d480a26a8 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:06:54.298326 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0608e9dc-b0b7-4ee6-b704-041f99221249 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/action" status: 200 len: 32 microversion: 2.1 time: 0.187394 Sep 09 23:06:54.299222 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 256/526] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:06:54 2022] POST /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:06:54.309958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:54.310340 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:54.327335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:54.327335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:54.327335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:54.327335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:54.327756 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:54.327756 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:54.486813 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:54.495178 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4bf391f3-6885-45de-88c8-39960851596d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.189736 Sep 09 23:06:54.495800 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 271/527] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:54 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:54.504286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:54.504992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:54.512735 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:54.512735 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:54.512735 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:54.513327 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:54.513789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:54.514215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:54.555649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:54.555649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:54.555649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:54.555649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lazy-loading 'fault' on Instance uuid d62121a3-5749-4ac2-887a-4eb11c33363f {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:06:54.595823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:54.603458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb0d4c3e-c225-42de-a3c7-955cfc37e58b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 200 len: 1332 microversion: 2.1 time: 0.103412 Sep 09 23:06:54.604041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 257/528] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:54 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:06:55.520278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:55.520919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:55.527204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:55.527713 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:55.528142 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:55.528819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:55.529267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:55.529690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:55.626386 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:55.627016 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:55.633323 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:55.633807 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:55.634232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:55.634914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:55.635362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:55.635807 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:55.649026 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f HTTP/1.1 Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:06:55.650646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:06:55.652235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'd62121a3-5749-4ac2-887a-4eb11c33363f'} Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:06:55.653186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:06:55.654656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:06:55.656600 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:06:55.656600 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78d0be5c-7cae-497a-afb4-0b4589e9de7e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 404 len: 111 microversion: 2.1 time: 0.030061 Sep 09 23:06:55.656600 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 258/529] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:55 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:06:55.659294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:55.661762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1dfadf4-1875-499b-b63b-bd3dd63adacc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '.version_select at 0x7fcecf2d5550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:55.668454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02bde06b-c16f-4e4f-9da8-670e95ffbf13 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.151963 Sep 09 23:06:55.669017 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 272/530] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:55 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:55.686898 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1dfadf4-1875-499b-b63b-bd3dd63adacc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012150447" status: 202 len: 0 microversion: 2.1 time: 0.028740 Sep 09 23:06:55.687518 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 259/531] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 9 23:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012150447 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:06:56.416479 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:56.416978 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:56.422813 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:56.423605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:56.424046 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:56.424738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:56.425203 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:56.425629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:56.505747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lazy-loading 'services' on Instance uuid 04df6bca-4a68-4c7c-a314-ab08a28dfec3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:06:56.576710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af1176ac-3e15-4a22-9123-7b1e6fa4d6b6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments/313dcb36-a664-4af7-8b18-4f788b317d39" status: 202 len: 0 microversion: 2.1 time: 0.164324 Sep 09 23:06:56.577397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 273/532] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:06:56 2022] DELETE /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments/313dcb36-a664-4af7-8b18-4f788b317d39 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:06:56.586525 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:56.588784 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:56.595741 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:56.596366 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:56.596771 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:56.597483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:56.597939 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:56.598370 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:56.627330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-55909e14-8563-4755-b60e-40f1cd49a9d6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Sep 09 23:06:56.628022 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 260/533] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:06:56 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:06:56.694006 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:56.694728 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:56.700768 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:56.701250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:56.701682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:56.702362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:56.703540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:56.703965 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:56.830956 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:56.839226 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88b19afa-3c29-422a-a5ee-4cb071b5e53b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.149426 Sep 09 23:06:56.839831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 274/534] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:56 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:57.639925 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:57.642874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:57.650210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:57.650687 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:57.651119 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:57.651846 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:57.652295 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:57.652720 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:57.682772 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8851d9bd-0d51-4d72-a870-b911b04b689b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047014 Sep 09 23:06:57.683545 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 261/535] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:06:57 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:06:57.862090 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:57.862698 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:57.869077 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:57.869560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:57.869999 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:57.870687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:57.871144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:57.871598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.004323 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:58.012504 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fdd97759-0e26-42a5-8f7a-2076cbab9a70 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.154251 Sep 09 23:06:58.013068 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 275/536] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:57 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:06:58.676638 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:58.677121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:58.684800 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.685288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.685728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.686426 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.686882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.687351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.694574 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:58.696879 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:58.702717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.703197 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.703670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.704362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.704817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.705242 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.715996 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a2285f4-4bc2-4465-b3fa-7d8af13c3b1d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments/feffbab5-11b8-4978-a112-c95c86a624f0" status: 200 len: 194 microversion: 2.20 time: 0.044086 Sep 09 23:06:58.723309 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 262/537] 10.222.0.17 () {60 vars in 1454 bytes} [Fri Sep 9 23:06:58 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments/feffbab5-11b8-4978-a112-c95c86a624f0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:06:58.737267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-716eb153-7569-4f02-b452-41e494071286 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046646 Sep 09 23:06:58.738048 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 276/538] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:06:58 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 23:06:58.788903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:58.789434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:58.795390 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.795906 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.797029 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.797721 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.798177 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.798599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.805841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:58.806455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:58.812432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.812919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.813359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.814057 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.814515 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.815160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.840040 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:06:58.842869 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:58.882151 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lazy-loading 'services' on Instance uuid 2052a904-5812-447c-b0ac-d3c9dc4321cb {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:06:58.918500 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-00b857c0-4c31-433e-9d37-0f2e64654495 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 204 len: 0 microversion: 2.1 time: 0.116855 Sep 09 23:06:58.919316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 277/539] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:06:58 2022] DELETE /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 23:06:58.928639 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:58.929342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:58.935739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.935986 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.936449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.937153 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.937609 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.938164 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.954748 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:06:58.966272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc25f45f-ed39-4711-8f78-fc48cdf24f19 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments/feffbab5-11b8-4978-a112-c95c86a624f0" status: 202 len: 0 microversion: 2.20 time: 0.184064 Sep 09 23:06:58.967202 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 263/540] 10.222.0.17 () {60 vars in 1457 bytes} [Fri Sep 9 23:06:58 2022] DELETE /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments/feffbab5-11b8-4978-a112-c95c86a624f0 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:06:58.976503 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:58.978904 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:58.986208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.986717 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.987150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:58.987878 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:58.988336 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:58.989390 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:59.019175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc44381a-4002-43c1-a717-390ee8ade7a2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046708 Sep 09 23:06:59.020018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 264/541] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 23:06:58 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:06:59.036829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:06:59.037349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:06:59.042992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:59.043512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:59.043932 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:59.044607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:06:59.045058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:06:59.045503 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:06:59.070620 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:59.079080 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d47a9c23-f928-4b46-9585-10080ebbffa9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1682 microversion: 2.1 time: 0.154669 Sep 09 23:06:59.079993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 278/542] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:58 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:06:59.177298 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:06:59.187026 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c2f02bb-cb4c-42da-8284-f4b364345c06 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.153838 Sep 09 23:06:59.187652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 265/543] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:06:59 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:00.032551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:00.034923 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:00.041804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:00.042291 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:00.042908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:00.043876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:00.044532 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:00.045152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:00.083077 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-514e53f9-a04e-493f-a9ce-39394b245762 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054810 Sep 09 23:07:00.083863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 279/544] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 23:07:00 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:07:00.102499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:00.103926 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:00.112327 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:00.112822 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:00.113260 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:00.113965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:00.114426 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:00.114857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:00.212110 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:00.212614 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:00.219680 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:00.220175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:00.220825 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:00.221723 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:00.222368 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:00.222959 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:00.344269 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:00.364956 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af7a3975-2fb3-4d9a-b9a4-7dfcb1abde1f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1682 microversion: 2.1 time: 0.266468 Sep 09 23:07:00.365727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 266/545] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:00 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:00.402032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:00.412912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1bd134fa-9d57-42ee-96f4-5c7fb8893554 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.205314 Sep 09 23:07:00.413782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 280/546] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:00 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:01.095889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:01.098491 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:01.106231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:01.107370 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:01.108122 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:01.109343 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:01.110037 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:01.110680 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:01.150362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ee6506d-789a-4f2a-9bf5-4b0390975303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058625 Sep 09 23:07:01.151144 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 267/547] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 23:07:01 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:07:01.391454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:01.392122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:01.401706 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:01.402207 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:01.402655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:01.403370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:01.403868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:01.404328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:01.445496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:01.446157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:01.455712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:01.456606 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:01.457752 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:01.458741 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:01.459686 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:01.460336 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:01.668179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:01.682697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f98e661d-a60d-4983-b120-6f7df62b2f5f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.244853 Sep 09 23:07:01.684261 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 268/548] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:01 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:01.760832 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:01.769736 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2771ff7c-67f2-4c66-bfec-a1fca4371696 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1682 microversion: 2.1 time: 0.382135 Sep 09 23:07:01.771449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 281/549] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:01 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1682 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:02.130426 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-caefdd4e-91ec-4e08-b159-d83ed65e20b3 req-f6821bbd-62b4-4877-8035-bcde01fd0912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04df6bca-4a68-4c7c-a314-ab08a28dfec3", "name": "network-vif-deleted", "tag": "a1982a7e-608a-4e41-ae98-2ee9fbdcdf4f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:02.143791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-caefdd4e-91ec-4e08-b159-d83ed65e20b3 req-f6821bbd-62b4-4877-8035-bcde01fd0912 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.144831 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-caefdd4e-91ec-4e08-b159-d83ed65e20b3 req-f6821bbd-62b4-4877-8035-bcde01fd0912 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.145602 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-caefdd4e-91ec-4e08-b159-d83ed65e20b3 req-f6821bbd-62b4-4877-8035-bcde01fd0912 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.160621 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-caefdd4e-91ec-4e08-b159-d83ed65e20b3 req-f6821bbd-62b4-4877-8035-bcde01fd0912 service nova] Creating event network-vif-deleted:a1982a7e-608a-4e41-ae98-2ee9fbdcdf4f for instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 on hv-cinder-85221 Sep 09 23:07:02.164319 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:02.166884 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:02.168709 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-caefdd4e-91ec-4e08-b159-d83ed65e20b3 req-f6821bbd-62b4-4877-8035-bcde01fd0912 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052063 Sep 09 23:07:02.169768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 269/550] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:02.178565 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.183859 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.184652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.185998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.186829 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.193268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.283232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7122beff-b42d-4018-a71e-8ef8a89cd7a7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.123183 Sep 09 23:07:02.285763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 282/551] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 23:07:02 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:02.441292 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:02.442136 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:02.449836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.450656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.451338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.466190 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.466750 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.467193 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.498613 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:07:02.652318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9c6c6e0-16c8-4304-aa65-29b06056f5e4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 204 len: 0 microversion: 2.20 time: 0.216488 Sep 09 23:07:02.652914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 270/552] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 9 23:07:02 2022] DELETE /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 23:07:02.662651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:02.663152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:02.683944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.684543 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.685023 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.685770 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.686334 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.686791 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.707857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:02.709050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:02.733201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.733731 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.734692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.735417 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.735910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.736342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.906748 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:02.915779 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83638d5c-6cac-4f5b-ac8c-ee2080dfd89b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.212109 Sep 09 23:07:02.916585 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 271/553] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:02 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:02.921315 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:02.922004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:02.928861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.929569 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.929956 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.931990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.931990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.931990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.964252 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:02.965032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:02.965032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:02.965487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lazy-loading 'fault' on Instance uuid 04df6bca-4a68-4c7c-a314-ab08a28dfec3 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:07:02.978911 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:02.990247 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:02.991877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:02.993085 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1334e93c-af22-4d24-96fd-c8b92c48db97 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.334893 Sep 09 23:07:02.993970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 283/554] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:02 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:03.010919 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:03.022797 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abb22de5-9ee4-4bd4-ad8d-55b7860c0069 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1332 microversion: 2.1 time: 0.105023 Sep 09 23:07:03.024360 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 272/555] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:02 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:03.957700 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:03.958491 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:03.980009 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:03.980896 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:03.981335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:03.982041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:03.982496 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:03.982920 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:04.022854 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:04.024074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:04.035467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:04.036254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:04.038871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:04.039782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:04.040393 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:04.041162 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:04.222452 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:04.228859 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:04.237003 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:04.238802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:04.240035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5792cebe-8255-4ad2-9f89-f9b5a4d72627 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.301018 Sep 09 23:07:04.240265 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-588b8f77-941c-48a7-9112-3604ea4744b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1724 microversion: 2.20 time: 0.222902 Sep 09 23:07:04.244030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 273/556] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:04 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:07:04.246533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 284/557] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:03 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:04.261557 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:04.262307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:04.270000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:04.270596 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:04.271149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:04.271943 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:04.272449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:04.272936 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:04.312481 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:04.313242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:04.313680 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:04.314269 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lazy-loading 'fault' on Instance uuid 04df6bca-4a68-4c7c-a314-ab08a28dfec3 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:07:04.368667 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:04.378243 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70c35b8a-0b78-4ab4-924b-4f4be95276b9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 200 len: 1332 microversion: 2.1 time: 0.121526 Sep 09 23:07:04.391985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 274/558] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:04 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 1332 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:05.290286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:05.291391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:05.292371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:05.293592 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:05.335217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:05.335752 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:05.336199 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:05.336911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:05.337389 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:05.337803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:05.350712 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:05.351214 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:05.351682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:05.355293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:05.359426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:05.362805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:05.573561 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:05.585184 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:05.588671 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:05.593703 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5aa6466-f479-41fb-b1cf-03ce30f2975b tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1656 microversion: 2.20 time: 0.318305 Sep 09 23:07:05.599203 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 285/559] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:05 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1656 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:05.613560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:05.613970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:05.629342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:05.629767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:05.630210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:05.633459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:05.633944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:05.634397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:05.671420 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 HTTP/1.1 Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:07:05.673361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:07:05.675083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '04df6bca-4a68-4c7c-a314-ab08a28dfec3'} Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:07:05.676055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:07:05.677502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:07:05.680018 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:07:05.681845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81ca79a0-6427-43ba-ba06-a486a84cb223 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 404 len: 111 microversion: 2.1 time: 0.085792 Sep 09 23:07:05.682592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 286/560] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:05 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:07:05.692362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e36dd624-0e8b-4a71-a403-36ac31cb1083 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '.version_select at 0x7fcecf38f790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:05.701765 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:05.710957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c50c70a-cb93-40f7-8b15-cc07f361e9a1 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.437319 Sep 09 23:07:05.711569 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 275/561] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:05 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:05.724164 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e36dd624-0e8b-4a71-a403-36ac31cb1083 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027347708" status: 202 len: 0 microversion: 2.1 time: 0.035262 Sep 09 23:07:05.725247 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 287/562] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 9 23:07:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027347708 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:07:06.033932 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f413cd1b-52a0-4a30-93d5-eae70e9533e3 req-3876d70a-2ca7-4ea3-bcf0-38c355b742a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2052a904-5812-447c-b0ac-d3c9dc4321cb", "name": "network-vif-deleted", "tag": "37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:06.054176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f413cd1b-52a0-4a30-93d5-eae70e9533e3 req-3876d70a-2ca7-4ea3-bcf0-38c355b742a3 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:06.054654 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f413cd1b-52a0-4a30-93d5-eae70e9533e3 req-3876d70a-2ca7-4ea3-bcf0-38c355b742a3 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:06.055087 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f413cd1b-52a0-4a30-93d5-eae70e9533e3 req-3876d70a-2ca7-4ea3-bcf0-38c355b742a3 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:06.088282 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f413cd1b-52a0-4a30-93d5-eae70e9533e3 req-3876d70a-2ca7-4ea3-bcf0-38c355b742a3 service nova] Creating event network-vif-deleted:37bc1c24-b5e8-49c5-a9c5-14c8b92c8cba for instance 2052a904-5812-447c-b0ac-d3c9dc4321cb on hv-cinder-85221 Sep 09 23:07:06.102896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f413cd1b-52a0-4a30-93d5-eae70e9533e3 req-3876d70a-2ca7-4ea3-bcf0-38c355b742a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072480 Sep 09 23:07:06.103719 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 276/563] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:06.631468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:06.633852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:06.650117 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:06.650867 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:06.651616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:06.652569 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:06.653249 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:06.654465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:06.733005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-124c8fe4-dbdf-49d9-aa20-ca734fe2ef54 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: .version_select at 0x7fcecf42d040>, body: {"keypair": {"name": "tempest-keypair-309658698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEp4Ee0rkCsjYNM2ny25AQqc/kRtnfytcTl4OeI8WIjDdLEsOCF7lj8M2dykNATfS+uEmqAOwHboG/iGIvo/mXU7+RuwSLvBewPqTlAUGK7fEbk5bhiWPnl5VLjruJKxLg=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:06.749970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-124c8fe4-dbdf-49d9-aa20-ca734fe2ef54 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for project cba38c443abf49a48bdb55f42dac68b0. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:07:06.755211 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-124c8fe4-dbdf-49d9-aa20-ca734fe2ef54 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for user 85cd8a90230b4c69886534be67acd943 and project cba38c443abf49a48bdb55f42dac68b0. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:07:06.789238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-124c8fe4-dbdf-49d9-aa20-ca734fe2ef54 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061455 Sep 09 23:07:06.790345 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 277/564] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:07:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:07:06.795769 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:06.797115 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:06.801511 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:06.805893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:06.806729 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:06.807410 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:06.808675 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:06.809348 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:06.810138 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:06.822290 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:06.826876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:06.831578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4490feb6-3259-4b1e-ab67-2975481aa913 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1366 microversion: 2.20 time: 0.210557 Sep 09 23:07:06.844456 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 288/565] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:06 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:06.988197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:06.997518 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1973f923-fcaf-412b-b893-9a64099d446b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1733 microversion: 2.1 time: 0.205975 Sep 09 23:07:06.998325 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 278/566] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:06 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:07.864098 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:07.865376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:07.896448 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:07.899908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:07.900875 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:07.901840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:07.903840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:07.906904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.019047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.020395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.022145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:08.022625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.023368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:08.027035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lazy-loading 'fault' on Instance uuid 2052a904-5812-447c-b0ac-d3c9dc4321cb {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:07:08.037369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.037946 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.038438 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.039180 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.045068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.045715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.341988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:08.355927 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c794d464-d4bc-4a78-b26f-2e360bf72bbf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1713 microversion: 2.1 time: 0.337452 Sep 09 23:07:08.357977 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 279/567] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:08 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1713 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:08.365644 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:08.379963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:08.383902 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:08.385631 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d7a4ea2f-fa3d-43b2-bcbf-fc9b11e8e244 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 200 len: 1371 microversion: 2.20 time: 0.527105 Sep 09 23:07:08.391265 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 289/568] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:07 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 1371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:08.595321 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:08.596197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:08.603189 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.603977 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.604641 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.605619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.606290 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.606932 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.632611 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:08.750704 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] HTTP exception thrown: Cannot 'detach_volume' instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 while it is in vm_state rescued Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Request method failure captured: Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments/3f2a8c95-a2a7-4790-89b4-459ef4868248 HTTP/1.1 Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YMi6ZzbmB27jSPQ1U4kf4RUObmjASl_OhA8mz0SjKjl4Vh6y6FTEgtBU3YAMjW_CZOA_TsB615F-OUgidE-l386CGo5SneVJLwHUryaBNIS55zAz5QWLzFIlEU36DefwbLD3JHo265zJDYosp2C6vCQJqVnQhrM-94DZktV4JCnn0 Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:07:08.754156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d688ef3e358c4822823707982fe4f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d688ef3e358c4822823707982fe4f654", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: e24e6fb4c69d48f7b2972b53fb8ea4a1 Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:07:08.755483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Cannot 'detach_volume' instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 while it is in vm_state rescued Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'server_id': 'f905f7dd-b5b2-42ab-a9a4-742d480a26a8', 'id': '3f2a8c95-a2a7-4790-89b4-459ef4868248'} Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:07:08.756172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 while it is in vm_state rescued Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 while it is in vm_state rescued Sep 09 23:07:08.757338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:08.760725 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Returning 409 to user: Cannot 'detach_volume' instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 while it is in vm_state rescued {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:07:08.762376 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cecf663f-2b7f-411e-b28b-a30da0170fbc tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments/3f2a8c95-a2a7-4790-89b4-459ef4868248" status: 409 len: 152 microversion: 2.1 time: 0.171356 Sep 09 23:07:08.763540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 280/569] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:07:08 2022] DELETE /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments/3f2a8c95-a2a7-4790-89b4-459ef4868248 => generated 152 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 23:07:08.772454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:08.772984 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:08.785668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.787578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.788032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.788753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.789214 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.789641 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.884983 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d971644e-033b-4233-b2d6-1b8ffbbca050 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "POST /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/action" status: 202 len: 0 microversion: 2.1 time: 0.116137 Sep 09 23:07:08.885983 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 290/570] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:07:08 2022] POST /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:07:08.894817 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:08.895747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:08.922362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.922930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.923377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:08.924134 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:08.924588 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:08.925010 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:09.049085 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-7298807", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1317db-d467-415d-ab18-3336278fd50c"}], "security_groups": [{"name": "tempest-securitygroup--1951764779"}], "key_name": "tempest-keypair-309658698", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:09.261026 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] validate_networks() for [('2c1317db-d467-415d-ab18-3336278fd50c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:07:09.856246 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:09.865136 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b402236-23c3-45a1-af9b-2e16ee294571 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1721 microversion: 2.1 time: 0.974040 Sep 09 23:07:09.865715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 281/571] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:08 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1721 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:09.875519 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:09.876994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:09.892296 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:09.893377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:09.894754 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:09.896520 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:09.897960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:09.899458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:09.944049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] HTTP exception thrown: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Request method failure captured: Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb HTTP/1.1 Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YM1Rph_Rjp-vagUJ1uQht2flZH2y96gSMQaiHJDvuz2h8rZ8KtOJjq0J_HCIVFBiJ7_nCG9IrkT6aaC3wske5Izzf2NnVshd6OGZenS3QKE4bX1270JaslCckt9JBBtMJ-OKKG5jvPsQtHX6b6lKEzbCqh1L-jH9GXE_uqghudZes Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:07:09.945893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8084c097adde47ffadcacca8f4d3ea73", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: eaef8f72768e4d1daf21257fdaf580d2 Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:07:09.947281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '2052a904-5812-447c-b0ac-d3c9dc4321cb'} Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:07:09.948079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:07:09.949254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:09.952009 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Returning 404 to user: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:07:09.953760 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e122c4e-5ded-40d5-8c62-82289a23a3b1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 404 len: 111 microversion: 2.20 time: 0.086838 Sep 09 23:07:09.954588 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 282/572] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:09 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:07:09.963321 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a75bbfba-f050-459b-94d1-77fd11ec5d54 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '.version_select at 0x7fcecf479670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:09.993770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a75bbfba-f050-459b-94d1-77fd11ec5d54 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666799760" status: 204 len: 0 microversion: 2.20 time: 0.033899 Sep 09 23:07:09.994906 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 283/573] 10.222.0.17 () {60 vars in 1262 bytes} [Fri Sep 9 23:07:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666799760 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 23:07:10.313131 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:07:10.314924 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:07:10.315425 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:07:10.316081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:07:10.316507 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:07:10.337668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:10.338882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:10.339655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:10.340581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:10.341571 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:10.342165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:10.380430 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for project cba38c443abf49a48bdb55f42dac68b0. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:07:10.385883 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for user 85cd8a90230b4c69886534be67acd943 and project cba38c443abf49a48bdb55f42dac68b0. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:07:10.404334 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:07:10.415611 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:07:10.527024 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-342ef6bb-65b8-4987-a3d2-4d59de8ec559 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.483373 Sep 09 23:07:10.528551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 291/574] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:07:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:07:10.549067 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b621a37-5e9e-4635-bf2a-fa3661146119 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:10.549997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b621a37-5e9e-4635-bf2a-fa3661146119 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:10.563816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:10.686676 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b621a37-5e9e-4635-bf2a-fa3661146119 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:10.694136 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b621a37-5e9e-4635-bf2a-fa3661146119 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1238 microversion: 2.1 time: 0.156636 Sep 09 23:07:10.694719 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 284/575] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:10 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1238 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:10.889549 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:10.890677 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:10.902966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:10.903724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:10.912336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:10.913299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:10.913934 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:10.914527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:11.259724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:11.271901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cdc2771-6921-499d-b031-e61aad2a4562 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1721 microversion: 2.1 time: 0.386710 Sep 09 23:07:11.272669 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 292/576] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:10 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1721 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:11.406163 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a68b126-5a2b-436c-b77b-66db95c9775f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'create', calling method: .version_select at 0x7fcecf3e24c0>, body: {"keypair": {"name": "tempest-keypair-759644213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlU2BY1WFkDxOS/XMEFbh5sHSPCEmAB1bJ2Rcy/UGTuKS11EIu6c+ocHjYqZ2xrYAir61gR3CiKJNNbomhoxW8i0p9wMIU7otdUOI2QlSjUGcQ98KlKzO26Ssgs7R7ayQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:11.431814 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-1a68b126-5a2b-436c-b77b-66db95c9775f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Getting quotas for project 8084c097adde47ffadcacca8f4d3ea73. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:07:11.437349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-1a68b126-5a2b-436c-b77b-66db95c9775f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Getting quotas for user eaef8f72768e4d1daf21257fdaf580d2 and project 8084c097adde47ffadcacca8f4d3ea73. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:07:11.465949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a68b126-5a2b-436c-b77b-66db95c9775f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.067321 Sep 09 23:07:11.473187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 285/577] 10.222.0.17 () {62 vars in 1200 bytes} [Fri Sep 9 23:07:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 23:07:11.718109 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:11.718704 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:11.732291 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:11.733002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:11.733679 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:11.734560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:11.744570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:11.745066 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:11.850054 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:11.855987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:11.866658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e9030f59-10da-44e5-89c7-c98e58b7e500 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1242 microversion: 2.1 time: 0.153204 Sep 09 23:07:11.869601 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 293/578] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:11 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:12.301804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:12.303705 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:12.310816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:12.311747 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:12.312432 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:12.313630 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:12.314447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:12.315114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:12.652394 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:12.680083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-289b39a9-63f1-4cee-a215-53e1db0cb498 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1727 microversion: 2.1 time: 0.385190 Sep 09 23:07:12.710840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:12.711701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:12.718950 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 286/579] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:12 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1727 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:12.725360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:12.726519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:12.727670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:12.728808 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:12.729519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:12.730182 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:12.871328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49c0354e-cd33-4d08-b9c3-fc897ab754cf tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167016 Sep 09 23:07:12.872255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 294/580] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 23:07:12 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:12.890898 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:12.891906 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:12.899385 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:12.900699 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:12.901470 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:12.902471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:12.903161 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:12.903855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:12.990114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:13.000105 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63930843-2699-4839-bb15-0b905e1bebef tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1290 microversion: 2.1 time: 0.113092 Sep 09 23:07:13.001358 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 287/581] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:12 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:13.907606 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1200822003", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "335d2839-6b04-4246-8754-db29f039c550"}], "security_groups": [{"name": "tempest-securitygroup--1401316794"}], "key_name": "tempest-keypair-759644213", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:13.916267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:14.026758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:14.027463 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:14.039457 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:14.041582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:14.042300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:14.043190 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:14.043913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:14.044557 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:14.051462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] validate_networks() for [('335d2839-6b04-4246-8754-db29f039c550', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:07:14.137439 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:14.146886 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2183a5e3-d708-4c5c-9686-14442b6a818b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1296 microversion: 2.1 time: 0.124728 Sep 09 23:07:14.160385 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 288/582] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:14 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1296 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:14.529740 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:07:14.531124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:07:14.532289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:07:14.532680 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:07:14.533297 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:07:14.544364 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:14.544963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:14.545465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:14.546482 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:14.547024 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:14.548036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:14.567454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Getting quotas for project 8084c097adde47ffadcacca8f4d3ea73. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:07:14.571458 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Getting quotas for user eaef8f72768e4d1daf21257fdaf580d2 and project 8084c097adde47ffadcacca8f4d3ea73. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:07:14.584032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:07:14.586287 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:07:14.644318 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-56d9bc1b-904e-41dd-b527-a78ace12fe60 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.742465 Sep 09 23:07:14.645073 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 295/583] 10.222.0.17 () {62 vars in 1188 bytes} [Fri Sep 9 23:07:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 23:07:14.656726 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9379ac8a-c8c8-4b04-8339-820e1946d551 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:14.657404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9379ac8a-c8c8-4b04-8339-820e1946d551 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:15.051008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9379ac8a-c8c8-4b04-8339-820e1946d551 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:15.065241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9379ac8a-c8c8-4b04-8339-820e1946d551 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:15.067230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9379ac8a-c8c8-4b04-8339-820e1946d551 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:15.070621 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9379ac8a-c8c8-4b04-8339-820e1946d551 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1281 microversion: 2.20 time: 0.417954 Sep 09 23:07:15.075091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 289/584] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:14 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1281 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:07:15.185691 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:15.189300 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:15.203367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:15.206845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:15.207610 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:15.212922 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:15.213586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:15.214207 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:15.413755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:15.443979 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-63ce002f-65fc-4e7a-aecd-5f29c262da7e req-65fd2503-2202-4593-b0b4-31cde4aa5766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f905f7dd-b5b2-42ab-a9a4-742d480a26a8", "tag": "ef102868-6f48-4e8a-8ce3-bb2980127db1"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:15.453472 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3da27ea0-3785-4ec9-828f-916de192dfd6 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1296 microversion: 2.1 time: 0.275314 Sep 09 23:07:15.454970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 296/585] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:15 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1296 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:15.494985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63ce002f-65fc-4e7a-aecd-5f29c262da7e req-65fd2503-2202-4593-b0b4-31cde4aa5766 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:15.495467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63ce002f-65fc-4e7a-aecd-5f29c262da7e req-65fd2503-2202-4593-b0b4-31cde4aa5766 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:15.495924 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63ce002f-65fc-4e7a-aecd-5f29c262da7e req-65fd2503-2202-4593-b0b4-31cde4aa5766 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:15.556799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-63ce002f-65fc-4e7a-aecd-5f29c262da7e req-65fd2503-2202-4593-b0b4-31cde4aa5766 service nova] Creating event network-changed:ef102868-6f48-4e8a-8ce3-bb2980127db1 for instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 on hv-cinder-85221 Sep 09 23:07:15.573189 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-63ce002f-65fc-4e7a-aecd-5f29c262da7e req-65fd2503-2202-4593-b0b4-31cde4aa5766 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132508 Sep 09 23:07:15.575897 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 290/586] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:07:16.098664 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:16.099283 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:16.112353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:16.112847 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:16.113285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:16.113995 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:16.114447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:16.114868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:16.262697 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:16.273103 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:16.275063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:16.276416 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b75edade-debc-46e3-9e04-89a647a3ecb7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1333 microversion: 2.20 time: 0.182117 Sep 09 23:07:16.292566 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 297/587] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:16 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1333 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:16.484113 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:16.484727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:16.500918 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:16.507915 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:16.508704 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:16.509727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:16.510411 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:16.511020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:17.034262 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:17.047762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72289e9e-371d-4cbd-ba94-ee3c5b3c70d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1364 microversion: 2.1 time: 0.569333 Sep 09 23:07:17.050437 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 291/588] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:16 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1364 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:17.305788 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:17.306772 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:17.328821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:17.330495 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:17.332693 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:17.335483 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:17.337596 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:17.339608 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:17.485364 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:17.503050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:17.506755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:17.509946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b82f6a79-9e53-42b3-9c6d-c5eb16529cf2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1339 microversion: 2.20 time: 0.210328 Sep 09 23:07:17.516560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 298/589] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:17 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1339 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:17.628401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a0a963cf-fbaf-408a-8e5c-0a708cc35258 req-3ecb4145-0ba6-4725-acb5-79971b01eab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f905f7dd-b5b2-42ab-a9a4-742d480a26a8", "tag": "ef102868-6f48-4e8a-8ce3-bb2980127db1"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:17.649755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a0a963cf-fbaf-408a-8e5c-0a708cc35258 req-3ecb4145-0ba6-4725-acb5-79971b01eab7 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:17.651202 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a0a963cf-fbaf-408a-8e5c-0a708cc35258 req-3ecb4145-0ba6-4725-acb5-79971b01eab7 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:17.651819 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a0a963cf-fbaf-408a-8e5c-0a708cc35258 req-3ecb4145-0ba6-4725-acb5-79971b01eab7 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:17.682466 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a0a963cf-fbaf-408a-8e5c-0a708cc35258 req-3ecb4145-0ba6-4725-acb5-79971b01eab7 service nova] Creating event network-changed:ef102868-6f48-4e8a-8ce3-bb2980127db1 for instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 on hv-cinder-85221 Sep 09 23:07:17.691274 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a0a963cf-fbaf-408a-8e5c-0a708cc35258 req-3ecb4145-0ba6-4725-acb5-79971b01eab7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068360 Sep 09 23:07:17.692485 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 292/590] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:07:18.070315 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:18.070831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:18.081139 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:18.081617 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:18.082224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:18.083084 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:18.089877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:18.090665 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:18.340630 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:18.350612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e8ff7130-d718-4678-b38f-cd2a1972e56e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1364 microversion: 2.1 time: 0.283909 Sep 09 23:07:18.363520 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 299/591] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:18 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:18.546609 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:18.546609 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:18.568509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:18.569036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:18.569474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:18.570187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:18.570637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:18.571057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:18.738334 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:18.754425 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:18.756096 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:18.757266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e8eb650-e741-4b3e-a54c-e6fb3275e8e6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1339 microversion: 2.20 time: 0.216833 Sep 09 23:07:18.772821 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 293/592] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:18 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:19.379459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:19.381220 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:19.406338 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:19.406841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:19.407286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:19.408038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:19.408705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:19.409296 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:19.769626 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:19.777785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9472109d-00bc-4aad-b873-b49b8efee591 req-21873a7a-c2d9-40bc-aa09-8e9c15b8f1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46f9130-09a3-430e-b22a-abc9830ed20f", "tag": "9464c26e-5e5a-4ad0-a8c8-bcce743a6ac0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:19.789910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9472109d-00bc-4aad-b873-b49b8efee591 req-21873a7a-c2d9-40bc-aa09-8e9c15b8f1f6 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:19.791400 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f65ea05d-0541-4939-9fb0-f4c12ad1fa92 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1364 microversion: 2.1 time: 0.415856 Sep 09 23:07:19.800188 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9472109d-00bc-4aad-b873-b49b8efee591 req-21873a7a-c2d9-40bc-aa09-8e9c15b8f1f6 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:19.800990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9472109d-00bc-4aad-b873-b49b8efee591 req-21873a7a-c2d9-40bc-aa09-8e9c15b8f1f6 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:19.814852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 300/593] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:19 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1364 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:19.821632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9472109d-00bc-4aad-b873-b49b8efee591 req-21873a7a-c2d9-40bc-aa09-8e9c15b8f1f6 service nova] Creating event network-changed:9464c26e-5e5a-4ad0-a8c8-bcce743a6ac0 for instance a46f9130-09a3-430e-b22a-abc9830ed20f on hv-cinder-85221 Sep 09 23:07:19.822683 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:19.823868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:19.836719 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9472109d-00bc-4aad-b873-b49b8efee591 req-21873a7a-c2d9-40bc-aa09-8e9c15b8f1f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107032 Sep 09 23:07:19.837639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 294/594] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:19.841171 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:19.841672 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:19.842118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:19.843371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:19.844812 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:19.851550 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:20.160826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:20.169532 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:20.171927 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:20.173282 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d643e946-f8f1-4de8-9cc8-074c282148ac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1407 microversion: 2.20 time: 0.357131 Sep 09 23:07:20.173843 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 301/595] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:19 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:20.819941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:20.820646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:20.828109 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:20.832437 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:20.833082 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:20.833968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:20.836731 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:20.837389 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:21.048515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:21.058321 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21b1ac7e-c2fc-4212-a155-59a0eed6c172 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1364 microversion: 2.1 time: 0.242474 Sep 09 23:07:21.061962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 295/596] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:20 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:21.202928 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:21.203561 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:21.213086 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:21.213856 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:21.214550 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:21.215610 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:21.216245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:21.216819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:21.404977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:21.418102 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:21.420678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:21.422488 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-23c5d9fc-e9b9-418f-b1cc-01521fe4e471 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1407 microversion: 2.20 time: 0.223651 Sep 09 23:07:21.423269 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 302/597] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:21 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:21.932339 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fcadd846-11f4-41c5-8115-9cee26ec4921 req-22099c3a-d0eb-4cab-bc70-9c6b42dc4361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479d8f15-a236-4cc4-835b-ddbb3ab4569b", "tag": "194395d4-13f2-4287-a338-5cc41afb196d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:21.952361 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fcadd846-11f4-41c5-8115-9cee26ec4921 req-22099c3a-d0eb-4cab-bc70-9c6b42dc4361 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:21.953244 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fcadd846-11f4-41c5-8115-9cee26ec4921 req-22099c3a-d0eb-4cab-bc70-9c6b42dc4361 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:21.955727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fcadd846-11f4-41c5-8115-9cee26ec4921 req-22099c3a-d0eb-4cab-bc70-9c6b42dc4361 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:21.974172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fcadd846-11f4-41c5-8115-9cee26ec4921 req-22099c3a-d0eb-4cab-bc70-9c6b42dc4361 service nova] Creating event network-changed:194395d4-13f2-4287-a338-5cc41afb196d for instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b on hv-cinder-85221 Sep 09 23:07:21.979433 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fcadd846-11f4-41c5-8115-9cee26ec4921 req-22099c3a-d0eb-4cab-bc70-9c6b42dc4361 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052138 Sep 09 23:07:21.980625 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 296/598] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:22.085259 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:22.086140 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:22.092285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:22.095785 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:22.096468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:22.097379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:22.097851 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:22.098288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:22.435094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:22.445475 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0c730825-b8fb-498c-84b3-aa33f4edf204 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1364 microversion: 2.1 time: 0.364102 Sep 09 23:07:22.446240 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 303/599] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:22 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1364 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:22.449302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:22.450542 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:22.460586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:22.461890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:22.462540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:22.463477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:22.464026 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:22.464683 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:22.612958 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:22.623394 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:22.626772 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:22.627982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d02c673e-9edf-44b9-bb88-cada628f9811 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1407 microversion: 2.20 time: 0.183365 Sep 09 23:07:22.636157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 297/600] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:22 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:23.469392 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:23.470790 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:23.478091 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:23.478790 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:23.479403 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:23.480989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:23.481622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:23.482223 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:23.642038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:23.649950 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-01364914-c544-4c67-b101-c0e33c7e0291 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1364 microversion: 2.1 time: 0.184388 Sep 09 23:07:23.650516 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 304/601] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:23 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:23.654455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:23.655348 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:23.662639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:23.663253 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:23.663827 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:23.664753 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:23.666082 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:23.666770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:23.808176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:23.820285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:23.822687 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:23.823912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4106af0f-3888-4974-8f6a-30a7f7776e14 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1407 microversion: 2.20 time: 0.173677 Sep 09 23:07:23.825230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 298/602] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:23 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:24.673078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:24.673917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:24.676330 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:24.677231 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:24.685872 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:24.686371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:24.686812 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:24.687545 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:24.688010 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:24.688622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:24.851236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:24.853662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:24.855981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:24.860949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45b81cb0-aeb1-48a2-9990-ed9fd55979b5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1364 microversion: 2.1 time: 0.191893 Sep 09 23:07:24.875201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 305/603] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:24 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:24.880499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:24.880996 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:24.881435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:24.882150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:24.882776 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:24.883210 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:25.064542 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:25.148805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-075f9e5c-4ae6-4fcf-98c4-c528db7c8aa7 req-593a1530-8c48-46dc-a37c-7effcbed277d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46f9130-09a3-430e-b22a-abc9830ed20f", "name": "network-vif-plugged", "status": "completed", "tag": "9464c26e-5e5a-4ad0-a8c8-bcce743a6ac0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:25.160764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:25.162132 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-075f9e5c-4ae6-4fcf-98c4-c528db7c8aa7 req-593a1530-8c48-46dc-a37c-7effcbed277d service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:25.162910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-075f9e5c-4ae6-4fcf-98c4-c528db7c8aa7 req-593a1530-8c48-46dc-a37c-7effcbed277d service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:25.164398 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-075f9e5c-4ae6-4fcf-98c4-c528db7c8aa7 req-593a1530-8c48-46dc-a37c-7effcbed277d service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:25.180871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:25.182623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:25.184643 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51d22b96-359d-49e0-b295-af2dc6614303 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1407 microversion: 2.20 time: 0.338328 Sep 09 23:07:25.185563 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 299/604] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:24 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:25.185730 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-075f9e5c-4ae6-4fcf-98c4-c528db7c8aa7 req-593a1530-8c48-46dc-a37c-7effcbed277d service nova] Creating event network-vif-plugged:9464c26e-5e5a-4ad0-a8c8-bcce743a6ac0 for instance a46f9130-09a3-430e-b22a-abc9830ed20f on hv-cinder-85221 Sep 09 23:07:25.191365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-075f9e5c-4ae6-4fcf-98c4-c528db7c8aa7 req-593a1530-8c48-46dc-a37c-7effcbed277d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048176 Sep 09 23:07:25.192230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 306/605] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:25.885103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:25.885806 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:25.893154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:25.893744 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:25.894512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:25.894987 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:25.895456 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:25.896384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:26.038877 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:26.051644 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22513a52-7002-41ca-903a-39aa3fcc5576 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1364 microversion: 2.1 time: 0.170381 Sep 09 23:07:26.052215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 300/606] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:25 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:26.211958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:26.213448 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:26.220652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:26.221146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:26.221583 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:26.222313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:26.222773 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:26.223199 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:26.360913 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:26.369615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:26.371365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:26.372915 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-659351f7-6479-4be5-a0ba-103c7ea18092 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1407 microversion: 2.20 time: 0.166175 Sep 09 23:07:26.373644 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 307/607] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:26 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:26.421800 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e98a852-a863-4517-a3e1-15acd9d2c9ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Action: 'create', calling method: .version_select at 0x7fcecf298820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1245104049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhtMzmr3LJp/oR9R1NMiu2K4UcUq1fGIigjl2ZFlDk1m9dHu0iLmLCOPiUVPSqKxWGTNvOipjIk0yRkdSzu/jyaDNVY5n3ZlQ753pMefHOaGWkJPSEDbFfGMax/SeFtew=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:26.437598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-0e98a852-a863-4517-a3e1-15acd9d2c9ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Getting quotas for project 52565b3ddbe9435e8112f134f6c5d496. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:07:26.441354 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-0e98a852-a863-4517-a3e1-15acd9d2c9ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Getting quotas for user 1bdf9e74be004e8ab24b9a15bb8904d2 and project 52565b3ddbe9435e8112f134f6c5d496. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:07:26.462951 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e98a852-a863-4517-a3e1-15acd9d2c9ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044935 Sep 09 23:07:26.463543 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 301/608] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:07:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:26.570195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-767571026", "imageRef": "3cd00d59-32c5-4ffc-a541-1ced3cfe258c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1245104049", "networks": [{"uuid": "55d5bf45-3f0c-4d2a-908d-66b4a156be45"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:26.621809 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] validate_networks() for [('55d5bf45-3f0c-4d2a-908d-66b4a156be45', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:07:27.002321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:07:27.002759 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:07:27.003231 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:07:27.003664 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:07:27.004071 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:07:27.014342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.015149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.015987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.016581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.017033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.017453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.033688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Getting quotas for project 52565b3ddbe9435e8112f134f6c5d496. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:07:27.037532 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Getting quotas for user 1bdf9e74be004e8ab24b9a15bb8904d2 and project 52565b3ddbe9435e8112f134f6c5d496. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:07:27.049253 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:07:27.051445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cd00d59-32c5-4ffc-a541-1ced3cfe258c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:07:27.077716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:27.078331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:27.084742 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.085434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.085979 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.086771 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.087236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.087680 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.100159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a3b66f8-b4c2-480c-8725-2258848bd026 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533619 Sep 09 23:07:27.106572 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 308/609] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:07:27.113300 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e05d731b-9e75-4463-be27-bdc9a4ca5ed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:27.114000 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e05d731b-9e75-4463-be27-bdc9a4ca5ed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:27.188311 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e05d731b-9e75-4463-be27-bdc9a4ca5ed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:27.195476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e05d731b-9e75-4463-be27-bdc9a4ca5ed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1258 microversion: 2.1 time: 0.086032 Sep 09 23:07:27.203530 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 309/610] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:27 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:27.225577 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d24bdafa-bc2a-4b3d-9a9c-b8e36ce216ab req-09e85425-f3cc-4948-9301-b19171e77d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479d8f15-a236-4cc4-835b-ddbb3ab4569b", "name": "network-vif-plugged", "status": "completed", "tag": "194395d4-13f2-4287-a338-5cc41afb196d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:27.237042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d24bdafa-bc2a-4b3d-9a9c-b8e36ce216ab req-09e85425-f3cc-4948-9301-b19171e77d33 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.237647 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d24bdafa-bc2a-4b3d-9a9c-b8e36ce216ab req-09e85425-f3cc-4948-9301-b19171e77d33 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.238133 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d24bdafa-bc2a-4b3d-9a9c-b8e36ce216ab req-09e85425-f3cc-4948-9301-b19171e77d33 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.250769 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d24bdafa-bc2a-4b3d-9a9c-b8e36ce216ab req-09e85425-f3cc-4948-9301-b19171e77d33 service nova] Creating event network-vif-plugged:194395d4-13f2-4287-a338-5cc41afb196d for instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b on hv-cinder-85221 Sep 09 23:07:27.257355 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d24bdafa-bc2a-4b3d-9a9c-b8e36ce216ab req-09e85425-f3cc-4948-9301-b19171e77d33 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036426 Sep 09 23:07:27.258548 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 310/611] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:07:27.262337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:27.271059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be63418d-f77d-47c4-9141-28c51b2cab89 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1554 microversion: 2.1 time: 0.197498 Sep 09 23:07:27.271404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 302/612] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:27 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:27.294615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:27.295208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:27.301921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.302422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.302843 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.303921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.304377 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.304966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.395468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c54dfa7b-4078-442a-a79d-404074dc455f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104950 Sep 09 23:07:27.398468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:27.398845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:27.399298 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 311/613] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 23:07:27 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:07:27.406687 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.407224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.407885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.408637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:27.409265 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:27.409739 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:27.760775 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:27.768873 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:27.770311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:27.771431 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6407ba02-a791-4cd0-952a-ee1d6e2c50e0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1407 microversion: 2.20 time: 0.377173 Sep 09 23:07:27.772024 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 303/614] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:27 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:28.218370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:28.218986 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:28.225271 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:28.225758 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:28.226329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:28.226880 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:28.227334 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:28.227787 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:28.294714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:28.302921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0a02125-e150-477b-9704-5485e4419d80 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1310 microversion: 2.1 time: 0.088896 Sep 09 23:07:28.303807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 312/615] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:28 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:28.752086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a33ae208-4ab8-48cb-b365-b256948e4c6a req-407ddbdc-c8d4-483b-8a3d-8ff8d43ea9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46f9130-09a3-430e-b22a-abc9830ed20f", "tag": "9464c26e-5e5a-4ad0-a8c8-bcce743a6ac0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:28.761583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a33ae208-4ab8-48cb-b365-b256948e4c6a req-407ddbdc-c8d4-483b-8a3d-8ff8d43ea9d1 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:28.762056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a33ae208-4ab8-48cb-b365-b256948e4c6a req-407ddbdc-c8d4-483b-8a3d-8ff8d43ea9d1 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:28.762483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a33ae208-4ab8-48cb-b365-b256948e4c6a req-407ddbdc-c8d4-483b-8a3d-8ff8d43ea9d1 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:28.773743 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a33ae208-4ab8-48cb-b365-b256948e4c6a req-407ddbdc-c8d4-483b-8a3d-8ff8d43ea9d1 service nova] Creating event network-changed:9464c26e-5e5a-4ad0-a8c8-bcce743a6ac0 for instance a46f9130-09a3-430e-b22a-abc9830ed20f on hv-cinder-85221 Sep 09 23:07:28.778558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a33ae208-4ab8-48cb-b365-b256948e4c6a req-407ddbdc-c8d4-483b-8a3d-8ff8d43ea9d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030969 Sep 09 23:07:28.779128 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 304/616] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:28.796101 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:28.796738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:28.802784 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:28.803533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:28.803967 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:28.804778 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:28.805234 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:28.805651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:28.938858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:28.948653 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:28.950248 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:28.951382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a492eb80-7b41-453c-8888-24f48a5a4c7f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1407 microversion: 2.20 time: 0.159116 Sep 09 23:07:28.952658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 313/617] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:28 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:29.326940 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:29.327777 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:29.334201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:29.334777 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:29.335274 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:29.336201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:29.336733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:29.337157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:29.400019 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:29.408256 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82b9bc63-cf4d-4d5a-a8da-9c9c35b63672 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1318 microversion: 2.1 time: 0.085767 Sep 09 23:07:29.408814 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 305/618] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:29 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1318 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:29.977082 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:29.977782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:29.984255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:29.984737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:29.985194 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:29.985884 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:29.986332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:29.986759 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:30.131124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:30.134827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:30.142118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:30.143813 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:30.144755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a292c71-35ad-4537-84a5-7c2311183224 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1600 microversion: 2.20 time: 0.171612 Sep 09 23:07:30.145547 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 314/619] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:07:29 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:07:30.169658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:30.170126 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:30.176289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:30.176990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:30.177428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:30.178123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:30.178832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:30.179253 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:30.183175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:30.334408 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f75ec78e-cd70-4d75-9861-2a8b56e2ce37 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.167560 Sep 09 23:07:30.345480 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 306/620] 10.222.0.17 () {60 vars in 1316 bytes} [Fri Sep 9 23:07:30 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:07:30.433273 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:30.434211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:30.449048 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:30.449757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:30.450367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:30.451277 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:30.452344 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:30.452778 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:30.568376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:30.580595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b13d9a99-f8f2-4dc4-a9bf-6dfd8fdff745 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1316 microversion: 2.1 time: 0.152163 Sep 09 23:07:30.600397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 315/621] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:30 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:31.625313 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:31.625989 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:31.631992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:31.632475 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:31.632912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:31.633604 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:31.634055 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:31.634483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:31.804690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:31.818119 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5f440031-1b99-42a4-96ea-f2d5109d47cb tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.197684 Sep 09 23:07:31.818743 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 307/622] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:31 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:31.872707 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d89595a1-b82b-427e-9b9c-177302be4891 req-0b590020-0483-465d-a609-40e67a0972e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479d8f15-a236-4cc4-835b-ddbb3ab4569b", "tag": "194395d4-13f2-4287-a338-5cc41afb196d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:31.883234 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d89595a1-b82b-427e-9b9c-177302be4891 req-0b590020-0483-465d-a609-40e67a0972e6 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:31.884020 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d89595a1-b82b-427e-9b9c-177302be4891 req-0b590020-0483-465d-a609-40e67a0972e6 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:31.884455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d89595a1-b82b-427e-9b9c-177302be4891 req-0b590020-0483-465d-a609-40e67a0972e6 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:31.896717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d89595a1-b82b-427e-9b9c-177302be4891 req-0b590020-0483-465d-a609-40e67a0972e6 service nova] Creating event network-changed:194395d4-13f2-4287-a338-5cc41afb196d for instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b on hv-cinder-85221 Sep 09 23:07:31.902149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d89595a1-b82b-427e-9b9c-177302be4891 req-0b590020-0483-465d-a609-40e67a0972e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032950 Sep 09 23:07:31.902754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 316/623] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:32.842342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:32.843926 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:32.852179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:32.852785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:32.853454 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:32.854435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:32.854896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:32.855322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:33.012486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:33.021104 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-619b859d-d363-4532-ac5b-96e7e61bf100 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.182616 Sep 09 23:07:33.031567 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 308/624] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:32 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:34.056552 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:34.057265 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:34.063424 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:34.063949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:34.064391 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:34.065092 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:34.065557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:34.065987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:34.205810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:34.213880 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65de9763-76b6-4772-b301-6eacb6f1386c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.163255 Sep 09 23:07:34.214402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 317/625] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:34 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:35.237900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:35.238588 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:35.245997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:35.246483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:35.246920 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:35.247655 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:35.248113 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:35.248539 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:35.388538 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:35.396878 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-06636360-481d-4139-a213-0816594750db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.162801 Sep 09 23:07:35.399737 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 309/626] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:35 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:36.420361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:36.420958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:36.427595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:36.428084 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:36.428781 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:36.429478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:36.429934 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:36.430363 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:36.567105 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:36.574899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8faf1a71-9671-4358-b1c8-aa3f26a50c7c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.158558 Sep 09 23:07:36.575684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 318/627] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:36 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:37.598319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:37.598962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:37.601278 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:37.606787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:37.607284 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:37.607775 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:37.608481 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:37.608939 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:37.609365 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:37.750698 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:37.758727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-47460d38-e8ba-4039-a6bd-15a4fb9c4de4 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.164182 Sep 09 23:07:37.759314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 310/628] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:37 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:38.783457 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:38.784284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:38.786279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:38.787071 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:38.794244 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:38.794720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:38.795188 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:38.795915 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:38.796369 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:38.796789 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:38.929160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:38.937113 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72511c29-c6db-4f90-9617-1501f522a6b9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.158096 Sep 09 23:07:38.937669 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 319/629] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:38 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:39.960384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:39.960993 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:39.967826 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:39.968302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:39.968733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:39.969410 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:39.969857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:39.970272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:40.308255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:40.315920 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebfc265e-28a7-44d4-98a1-914ca804830b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.359420 Sep 09 23:07:40.316483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 311/630] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:39 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:40.603155 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b942dcc6-725c-415b-b9cc-4e2b289bc0da req-21be7155-9e70-4f7f-b60e-be1ee118eb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b843e4fc-3be4-452c-a494-ac0093397048", "tag": "279bf0ab-3755-42fc-a26c-13b4e5a027af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:40.615115 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b942dcc6-725c-415b-b9cc-4e2b289bc0da req-21be7155-9e70-4f7f-b60e-be1ee118eb64 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:40.615616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b942dcc6-725c-415b-b9cc-4e2b289bc0da req-21be7155-9e70-4f7f-b60e-be1ee118eb64 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:40.616031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b942dcc6-725c-415b-b9cc-4e2b289bc0da req-21be7155-9e70-4f7f-b60e-be1ee118eb64 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:40.627664 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b942dcc6-725c-415b-b9cc-4e2b289bc0da req-21be7155-9e70-4f7f-b60e-be1ee118eb64 service nova] Creating event network-changed:279bf0ab-3755-42fc-a26c-13b4e5a027af for instance b843e4fc-3be4-452c-a494-ac0093397048 on hv-cinder-85221 Sep 09 23:07:40.632687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b942dcc6-725c-415b-b9cc-4e2b289bc0da req-21be7155-9e70-4f7f-b60e-be1ee118eb64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033526 Sep 09 23:07:40.633286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 320/631] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:41.339790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:41.340403 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:41.344559 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 23:07:41.344712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Fri Sep 9 23:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 (ip 10.222.0.17) !!! Sep 09 23:07:41.347553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:41.356418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:41.356905 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:41.357340 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:41.358558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:41.359010 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:41.359429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:41.490433 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:41.498097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be7f6908-b4b4-4886-9bd1-68d60cf4ca6a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.162503 Sep 09 23:07:41.498660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 312/632] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:41 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:42.522210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:42.522946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:42.529269 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:42.529767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:42.530185 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:42.530875 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:42.531329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:42.531784 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:42.665027 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:42.673315 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b2b4882c-f186-450f-b6c6-e2d947909bf9 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.155997 Sep 09 23:07:42.673884 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 321/633] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:42 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:43.696801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:43.697416 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:43.704832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:43.705321 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:43.705764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:43.706457 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:43.706916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:43.707347 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:43.835135 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:43.842649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12860e67-23bf-4a04-8802-1acbad033f36 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.150033 Sep 09 23:07:43.843215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 313/634] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:43 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:44.865710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:44.866311 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:44.868707 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:44.873759 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:44.874243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:44.874673 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:44.875362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:44.875827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:44.876245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:45.015075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:45.022749 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e35cd122-cafd-4982-af02-869fe9f221a2 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.160942 Sep 09 23:07:45.023557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 322/635] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:44 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:46.046782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:46.047386 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:46.054852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:46.055325 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:46.055786 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:46.056465 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:46.056914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:46.057333 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:46.183028 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:46.190663 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b47a362e-bfc9-4598-aec2-a01616ddeed3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.148311 Sep 09 23:07:46.191229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 314/636] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:46 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:47.033757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-37335c48-c19a-4ed7-9b02-054046df5c96 req-4e365586-ecc4-4a2d-ae0c-711ae1d4a366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b843e4fc-3be4-452c-a494-ac0093397048", "name": "network-vif-plugged", "status": "completed", "tag": "279bf0ab-3755-42fc-a26c-13b4e5a027af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:47.044129 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37335c48-c19a-4ed7-9b02-054046df5c96 req-4e365586-ecc4-4a2d-ae0c-711ae1d4a366 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:47.044610 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37335c48-c19a-4ed7-9b02-054046df5c96 req-4e365586-ecc4-4a2d-ae0c-711ae1d4a366 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:47.045546 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37335c48-c19a-4ed7-9b02-054046df5c96 req-4e365586-ecc4-4a2d-ae0c-711ae1d4a366 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:47.057212 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-37335c48-c19a-4ed7-9b02-054046df5c96 req-4e365586-ecc4-4a2d-ae0c-711ae1d4a366 service nova] Creating event network-vif-plugged:279bf0ab-3755-42fc-a26c-13b4e5a027af for instance b843e4fc-3be4-452c-a494-ac0093397048 on hv-cinder-85221 Sep 09 23:07:47.062627 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-37335c48-c19a-4ed7-9b02-054046df5c96 req-4e365586-ecc4-4a2d-ae0c-711ae1d4a366 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Sep 09 23:07:47.063511 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 323/637] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:47.213780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:47.214401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:47.220820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:47.221305 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:47.221746 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:47.222469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:47.222928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:47.223383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:47.411175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:47.418731 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29cca0cb-cddc-4823-a226-5e628c1b2569 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.209246 Sep 09 23:07:47.419329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 315/638] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:47 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:47.957668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:47.958244 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:47.964365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:47.964843 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:47.965278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:47.965957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:47.966739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:47.968022 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:48.048916 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lazy-loading 'services' on Instance uuid f905f7dd-b5b2-42ab-a9a4-742d480a26a8 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:07:48.119848 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a222998-d4c1-4ab1-b532-20105a568ac4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments/3f2a8c95-a2a7-4790-89b4-459ef4868248" status: 202 len: 0 microversion: 2.1 time: 0.166318 Sep 09 23:07:48.120427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 324/639] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:07:47 2022] DELETE /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments/3f2a8c95-a2a7-4790-89b4-459ef4868248 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:07:48.128971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:48.131326 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:48.137318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:48.137804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:48.138239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:48.139417 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:48.139903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:48.140334 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:48.169812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82d106c2-9951-4ac0-86e8-1efd49a122ee tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Sep 09 23:07:48.170373 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 316/640] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:07:48 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:48.443212 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:48.443935 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:48.450015 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:48.450492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:48.450920 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:48.452288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:48.452738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:48.453157 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:48.586592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:48.594226 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea52c79b-2b32-40ed-a04d-65b4d4a90a0a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1358 microversion: 2.1 time: 0.155313 Sep 09 23:07:48.594783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 325/641] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:48 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:49.183021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:49.185217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:49.192013 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:49.192502 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:49.192933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:49.193830 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:49.194287 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:49.194712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:49.224695 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96687803-4f0d-485c-a85a-6a6e45314f5a tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046742 Sep 09 23:07:49.225242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 317/642] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:07:49 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:49.617441 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:49.618036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:49.624361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:49.624836 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:49.625268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:49.625949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:49.626403 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:49.626830 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:49.765763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:49.773401 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e23eeb6b-442b-4e3d-b44e-83e91bf1af4e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1547 microversion: 2.1 time: 0.159976 Sep 09 23:07:49.773966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 326/643] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:49 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:49.796690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:49.797297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:49.803269 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:49.804038 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:49.804473 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:49.805164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:49.805670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:49.806038 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:49.938208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:49.945933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08345f1d-f8e3-40eb-9425-9948a8e17453 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1547 microversion: 2.1 time: 0.153074 Sep 09 23:07:49.946503 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 318/644] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:49 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:49.968069 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:49.973078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:49.973917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Searching by: {'deleted': False, 'project_id': '52565b3ddbe9435e8112f134f6c5d496'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 23:07:49.980774 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:49.981260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:49.981699 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:49.982466 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:49.982931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:49.983358 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.079148 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 23:07:50.173842 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-893f6ef5-5f75-421b-a33e-36e5444bf70d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209394 Sep 09 23:07:50.174348 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 327/645] 10.222.0.17 () {58 vars in 1125 bytes} [Fri Sep 9 23:07:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:50.186961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:50.187646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:50.193945 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:50.194421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:50.194847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.195560 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:50.196010 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:50.196428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.237856 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:50.240185 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:50.245994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:50.246480 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:50.246915 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.247646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:50.248850 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:50.249273 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.279075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7157bac2-d539-4439-a81c-240bf7d19a55 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045345 Sep 09 23:07:50.279675 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 328/646] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:07:50 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 23:07:50.328048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:50.335915 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-230bedce-8559-4d45-930a-96722a5c0dce tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1547 microversion: 2.1 time: 0.153361 Sep 09 23:07:50.336476 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 319/647] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:50 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:50.355305 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:50.355929 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:50.362883 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:50.363425 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:50.363953 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.364703 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:50.365419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:50.365920 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.393107 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:07:50.469919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b051e3c0-9db9-4a2c-9fda-05c80e839997 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 204 len: 0 microversion: 2.1 time: 0.118138 Sep 09 23:07:50.471114 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 329/648] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:07:50 2022] DELETE /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:07:50.479154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:50.479887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:50.487294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:50.487930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:50.488708 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.489541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:50.490203 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:50.490630 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:50.643258 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:50.651568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5dddb148-eacf-4c55-b2d4-45354fcd797b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1687 microversion: 2.1 time: 0.176494 Sep 09 23:07:50.652171 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 320/649] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:50 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:51.687129 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:51.687864 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:51.694185 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:51.694671 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:51.695106 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:51.695823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:51.696281 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:51.696706 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:51.831584 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:51.835090 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:51.840394 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31bcabee-2144-438e-9893-28369482828b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1687 microversion: 2.1 time: 0.157979 Sep 09 23:07:51.841200 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 330/650] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:51 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:51.903899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "062b399d-c0a6-44df-ab6b-aba33e605594"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:51.906890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:51.913222 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:51.913703 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:51.914137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:51.914820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:51.915303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:51.915775 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:52.863787 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:52.864399 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:52.872005 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:52.872506 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:52.873440 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:52.874136 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:52.874594 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:52.875016 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:53.002646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:53.010285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-732efdce-2f4a-41d8-aa42-b0a8e95d1bd8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1687 microversion: 2.1 time: 0.150474 Sep 09 23:07:53.010851 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 331/651] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:52 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:54.034449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:54.035071 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:54.041414 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:54.041897 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:54.042332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:54.043020 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:54.043474 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:54.043932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:54.171175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:54.179233 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b70951d-f792-4b70-b18d-d47c746720f3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1687 microversion: 2.1 time: 0.148587 Sep 09 23:07:54.179912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 332/652] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:54 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:54.337140 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:07:54.348257 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5785015c-a3f2-482d-800f-f7ad8cdaf316 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "POST /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.448329 Sep 09 23:07:54.348856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 321/653] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:07:51 2022] POST /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments => generated 194 bytes in 2450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:55.203236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:55.204027 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:55.210648 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:55.211138 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:55.212220 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:55.213877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:55.214352 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:55.215255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:55.293309 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:55.302693 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cee4c4cc-ccea-4c84-96bd-7784253bf5a3 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1620 microversion: 2.1 time: 0.103561 Sep 09 23:07:55.303274 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 333/654] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:55 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1620 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:07:55.540970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-009cb67c-a3f7-4828-81a9-12a24d6a6dd3 req-91990efa-66ef-4bf6-bb82-dbad3b9e4529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f905f7dd-b5b2-42ab-a9a4-742d480a26a8", "name": "network-vif-deleted", "tag": "ef102868-6f48-4e8a-8ce3-bb2980127db1"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:07:55.552580 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-009cb67c-a3f7-4828-81a9-12a24d6a6dd3 req-91990efa-66ef-4bf6-bb82-dbad3b9e4529 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:55.553074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-009cb67c-a3f7-4828-81a9-12a24d6a6dd3 req-91990efa-66ef-4bf6-bb82-dbad3b9e4529 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:55.553768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-009cb67c-a3f7-4828-81a9-12a24d6a6dd3 req-91990efa-66ef-4bf6-bb82-dbad3b9e4529 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:55.567371 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-009cb67c-a3f7-4828-81a9-12a24d6a6dd3 req-91990efa-66ef-4bf6-bb82-dbad3b9e4529 service nova] Creating event network-vif-deleted:ef102868-6f48-4e8a-8ce3-bb2980127db1 for instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 on hv-cinder-85221 Sep 09 23:07:55.572639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-009cb67c-a3f7-4828-81a9-12a24d6a6dd3 req-91990efa-66ef-4bf6-bb82-dbad3b9e4529 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036053 Sep 09 23:07:55.573218 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 322/655] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:07:56.326289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:56.326991 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:56.333526 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:56.334093 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:56.334599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:56.335367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:56.335964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:56.336392 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:56.368527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:56.369015 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:56.369455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:56.369898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lazy-loading 'fault' on Instance uuid f905f7dd-b5b2-42ab-a9a4-742d480a26a8 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:07:56.417661 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:07:56.425941 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-94c76278-d578-4dd0-8335-3936734c4ad4 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 200 len: 1334 microversion: 2.1 time: 0.103576 Sep 09 23:07:56.426506 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 334/656] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:56 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:07:57.449582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:57.450294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: f905f7dd-b5b2-42ab-a9a4-742d480a26a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:07:57.457490 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:57.457970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:57.458404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:57.459084 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:07:57.459557 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:07:57.459985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:07:57.472707 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] HTTP exception thrown: Instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 could not be found. Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Request method failure captured: Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 HTTP/1.1 Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YMi6ZzbmB27jSPQ1U4kf4RUObmjASl_OhA8mz0SjKjl4Vh6y6FTEgtBU3YAMjW_CZOA_TsB615F-OUgidE-l386CGo5SneVJLwHUryaBNIS55zAz5QWLzFIlEU36DefwbLD3JHo265zJDYosp2C6vCQJqVnQhrM-94DZktV4JCnn0 Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:07:57.474288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d688ef3e358c4822823707982fe4f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d688ef3e358c4822823707982fe4f654", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: e24e6fb4c69d48f7b2972b53fb8ea4a1 Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 could not be found. Sep 09 23:07:57.475922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'f905f7dd-b5b2-42ab-a9a4-742d480a26a8'} Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 could not be found. Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:07:57.476728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 could not be found. Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 could not be found. Sep 09 23:07:57.478114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:07:57.479221 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Returning 404 to user: Instance f905f7dd-b5b2-42ab-a9a4-742d480a26a8 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:07:57.479221 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5df1f636-c670-49af-bf3d-c641b4411c42 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8" status: 404 len: 111 microversion: 2.1 time: 0.030308 Sep 09 23:07:57.479221 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 323/657] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:07:57 2022] GET /compute/v2.1/servers/f905f7dd-b5b2-42ab-a9a4-742d480a26a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:07:57.484272 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab809feb-5a26-4bf8-9ab4-6697143954c2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '.version_select at 0x7fcecf20eca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:07:57.502557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab809feb-5a26-4bf8-9ab4-6697143954c2 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585194700" status: 202 len: 0 microversion: 2.1 time: 0.022097 Sep 09 23:07:57.503108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 335/658] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 9 23:07:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585194700 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:08:00.351672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:00.352153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:00.358547 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:00.359023 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:00.359455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:00.360157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:00.360665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:00.361086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:00.387107 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:08:00.458620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d989ea36-5be7-428c-a77b-8e0e2415c852 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "DELETE /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 204 len: 0 microversion: 2.1 time: 0.110584 Sep 09 23:08:00.459187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 324/659] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:08:00 2022] DELETE /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:08:00.464553 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:00.468598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:00.469417 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:00.476234 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:00.476716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:00.477150 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:00.477837 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:00.478294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:00.478717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:00.607019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:00.615128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ef849b4-8fd8-4d04-8be4-1f79d071d0f8 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1507 microversion: 2.1 time: 0.151863 Sep 09 23:08:00.615720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 336/660] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:00 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:01.639834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:01.640607 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:01.646874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:01.647351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:01.647820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:01.648502 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:01.648949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:01.649369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:01.784132 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:01.791701 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e41da5bb-5580-466e-b00e-8518859bbb51 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1507 microversion: 2.1 time: 0.156718 Sep 09 23:08:01.792270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 325/661] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:01 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:02.814770 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:02.815376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:02.821738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:02.822216 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:02.822647 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:02.823329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:02.823809 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:02.824231 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:02.952652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:02.960173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-573c3218-f886-42a6-b50a-597a0c2676ba tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1507 microversion: 2.1 time: 0.149869 Sep 09 23:08:02.960741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 337/662] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:02 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:03.098403 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:03.098911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:03.105308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:03.105789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:03.106225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:03.106910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:03.107359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:03.107829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:03.134202 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:08:03.205437 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-199b18a0-0d87-44a2-b1a2-4ae5145c5a84 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 204 len: 0 microversion: 2.1 time: 0.110640 Sep 09 23:08:03.206002 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 326/663] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:08:03 2022] DELETE /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:08:03.213991 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:03.214600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:03.220963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:03.221445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:03.221877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:03.222561 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:03.223016 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:03.223442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:03.352294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:03.361412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15073532-3556-4e54-b20e-50da38c0e8f1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1577 microversion: 2.1 time: 0.151143 Sep 09 23:08:03.361977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 338/664] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:03 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:03.983758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:03.984392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:03.990353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:03.990823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:03.991248 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:03.991949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:03.992397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:03.992814 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:04.119342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:04.126903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e3981b13-a963-48d8-a59e-3ec46aadc619 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1507 microversion: 2.1 time: 0.148058 Sep 09 23:08:04.127453 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 327/665] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:03 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:04.444792 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:04.445408 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:04.452320 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:04.452810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:04.453253 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:04.454059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:04.454518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:04.454945 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:04.593461 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:04.601164 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db3eed07-1462-4bfa-8eae-1336270deaad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1577 microversion: 2.1 time: 0.160298 Sep 09 23:08:04.601732 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 339/666] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:04 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:05.149866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:05.150547 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:05.156957 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:05.157440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:05.157876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:05.158568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:05.159024 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:05.159449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:05.294492 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:05.302678 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e6ffeea-15e0-4491-a31b-659b893ab2c7 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1507 microversion: 2.1 time: 0.156815 Sep 09 23:08:05.303241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 328/667] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:05 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:05.625865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:05.626468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:05.632896 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:05.633373 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:05.633798 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:05.634508 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:05.634953 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:05.635369 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:05.771339 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:05.779384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e919833b-9c8a-4c6e-bde1-a6e17ab5644b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1577 microversion: 2.1 time: 0.157820 Sep 09 23:08:05.780007 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 340/668] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:05 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:06.184192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:06.184739 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:06.190732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:06.191217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:06.191683 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:06.192374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:06.192828 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:06.193253 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:06.326652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:06.327443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:06.334041 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:06.334745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:06.335558 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:06.336402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:06.337050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:06.337596 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:06.415745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:06.425034 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f50c368d-5730-4cae-b402-d2d4ec313ac9 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 200 len: 1465 microversion: 2.1 time: 0.102583 Sep 09 23:08:06.425618 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 341/669] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:06 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 1465 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:06.459103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:06.468515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be48454e-6063-4ee1-9351-d5e82aad629a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1593 microversion: 2.1 time: 0.288040 Sep 09 23:08:06.469281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 329/670] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:06 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1593 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:06.506599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6fe72a76-af9e-4b3e-8a14-b93bcb0e2ded req-57851123-ce78-48ed-9c44-948d4e71ad23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424d37d5-0527-4e4c-8a5f-e2b37084c377", "name": "network-vif-deleted", "tag": "305a5529-c5e4-4c1c-b702-2efb42e3dc58"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:06.518101 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6fe72a76-af9e-4b3e-8a14-b93bcb0e2ded req-57851123-ce78-48ed-9c44-948d4e71ad23 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:06.518950 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6fe72a76-af9e-4b3e-8a14-b93bcb0e2ded req-57851123-ce78-48ed-9c44-948d4e71ad23 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:06.519817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6fe72a76-af9e-4b3e-8a14-b93bcb0e2ded req-57851123-ce78-48ed-9c44-948d4e71ad23 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:06.533032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6fe72a76-af9e-4b3e-8a14-b93bcb0e2ded req-57851123-ce78-48ed-9c44-948d4e71ad23 service nova] Creating event network-vif-deleted:305a5529-c5e4-4c1c-b702-2efb42e3dc58 for instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 on hv-cinder-85221 Sep 09 23:08:06.540354 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6fe72a76-af9e-4b3e-8a14-b93bcb0e2ded req-57851123-ce78-48ed-9c44-948d4e71ad23 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112017 Sep 09 23:08:06.547222 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 342/671] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:06.802285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:06.802825 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:06.809677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:06.810166 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:06.810800 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:06.811558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:06.812192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:06.812646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:06.911464 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:06.920338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e96d524-8789-4254-9b5e-213e0bdf0eb2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1509 microversion: 2.1 time: 0.121984 Sep 09 23:08:06.921130 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 330/672] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:06 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1509 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:07.452316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:07.453656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 424d37d5-0527-4e4c-8a5f-e2b37084c377] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:07.461999 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.462951 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.463631 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:07.464855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.465471 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.466097 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:07.481754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] HTTP exception thrown: Instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 could not be found. Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Request method failure captured: Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 HTTP/1.1 Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YMi6ZzbmB27jSPQ1U4kf4RUObmjASl_OhA8mz0SjKjl4Vh6y6FTEgtBU3YAMjW_CZOA_TsB615F-OUgidE-l386CGo5SneVJLwHUryaBNIS55zAz5QWLzFIlEU36DefwbLD3JHo265zJDYosp2C6vCQJqVnQhrM-94DZktV4JCnn0 Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:08:07.484137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d688ef3e358c4822823707982fe4f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d688ef3e358c4822823707982fe4f654", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: e24e6fb4c69d48f7b2972b53fb8ea4a1 Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 could not be found. Sep 09 23:08:07.485525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '424d37d5-0527-4e4c-8a5f-e2b37084c377'} Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 could not be found. Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:08:07.486383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 could not be found. Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 could not be found. Sep 09 23:08:07.487853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:07.490670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Returning 404 to user: Instance 424d37d5-0527-4e4c-8a5f-e2b37084c377 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:08:07.491598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-061d22a7-ce51-4c9d-8f53-8b20c1451c94 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377" status: 404 len: 111 microversion: 2.1 time: 0.045160 Sep 09 23:08:07.492157 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 343/673] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:07 2022] GET /compute/v2.1/servers/424d37d5-0527-4e4c-8a5f-e2b37084c377 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:08:07.501052 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:07.502278 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:07.508961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.509695 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.510235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:07.511020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.511582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.512085 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:07.540218 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:08:07.643034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f337bb0-0989-49d0-b0c7-5dacdd76062d tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "DELETE /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 204 len: 0 microversion: 2.1 time: 0.146318 Sep 09 23:08:07.645497 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 331/674] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:08:07 2022] DELETE /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:08:07.653658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:07.654579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:07.661227 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.661959 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.662626 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:07.663546 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.664198 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.664816 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:07.868964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:07.878169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee189595-863a-409e-bdf3-a2c747c58172 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.228130 Sep 09 23:08:07.879108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 344/675] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:07 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:07.945297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:07.946863 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:07.952284 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.952779 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.953228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:07.953921 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.955096 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.955716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:07.998576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:07.998985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:07.999641 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:08.000100 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lazy-loading 'fault' on Instance uuid a0f3832e-f300-4e35-b871-2f2c9dc4cc83 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:08:08.046505 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:08.057003 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-199c1279-0c6d-46bd-92e4-8f75e3a7dcf1 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1229 microversion: 2.1 time: 0.115973 Sep 09 23:08:08.057872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 332/676] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:07 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:08.561689 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a30b805f-0fe6-4a2b-8d06-ae6041e4b6f8 req-ccbb957a-d12f-4daf-91a1-fc8c2e019c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f3832e-f300-4e35-b871-2f2c9dc4cc83", "name": "network-vif-deleted", "tag": "26a50981-3889-47e3-800b-120dfa1971a2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:08.572625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a30b805f-0fe6-4a2b-8d06-ae6041e4b6f8 req-ccbb957a-d12f-4daf-91a1-fc8c2e019c0e service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:08.573235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a30b805f-0fe6-4a2b-8d06-ae6041e4b6f8 req-ccbb957a-d12f-4daf-91a1-fc8c2e019c0e service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:08.573759 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a30b805f-0fe6-4a2b-8d06-ae6041e4b6f8 req-ccbb957a-d12f-4daf-91a1-fc8c2e019c0e service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:08.587114 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a30b805f-0fe6-4a2b-8d06-ae6041e4b6f8 req-ccbb957a-d12f-4daf-91a1-fc8c2e019c0e service nova] Creating event network-vif-deleted:26a50981-3889-47e3-800b-120dfa1971a2 for instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 on hv-cinder-85221 Sep 09 23:08:08.592518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a30b805f-0fe6-4a2b-8d06-ae6041e4b6f8 req-ccbb957a-d12f-4daf-91a1-fc8c2e019c0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035829 Sep 09 23:08:08.593319 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 345/677] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:08.674307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c0eca3ce-13c0-4077-b7aa-3fd59d4d52d5 req-d3099843-68df-40b2-a32f-44f7893e2063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b843e4fc-3be4-452c-a494-ac0093397048", "tag": "279bf0ab-3755-42fc-a26c-13b4e5a027af"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:08.685272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c0eca3ce-13c0-4077-b7aa-3fd59d4d52d5 req-d3099843-68df-40b2-a32f-44f7893e2063 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:08.685793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c0eca3ce-13c0-4077-b7aa-3fd59d4d52d5 req-d3099843-68df-40b2-a32f-44f7893e2063 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:08.687194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c0eca3ce-13c0-4077-b7aa-3fd59d4d52d5 req-d3099843-68df-40b2-a32f-44f7893e2063 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:08.699316 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c0eca3ce-13c0-4077-b7aa-3fd59d4d52d5 req-d3099843-68df-40b2-a32f-44f7893e2063 service nova] Creating event network-changed:279bf0ab-3755-42fc-a26c-13b4e5a027af for instance b843e4fc-3be4-452c-a494-ac0093397048 on hv-cinder-85221 Sep 09 23:08:08.705294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c0eca3ce-13c0-4077-b7aa-3fd59d4d52d5 req-d3099843-68df-40b2-a32f-44f7893e2063 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096578 Sep 09 23:08:08.706078 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 333/678] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:08.901042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:08.901739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:08.907817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:08.908301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:08.908732 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:08.909609 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:08.910253 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:08.910628 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:09.061645 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:09.070285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77dff44d-e58c-4913-873c-9a6a4cd7a59f tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.173369 Sep 09 23:08:09.070866 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 346/679] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:08 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:09.081366 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:09.082166 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:09.088548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:09.089095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:09.089734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:09.090624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:09.091432 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:09.092065 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:09.123155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:09.124499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:09.125091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:09.125675 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lazy-loading 'fault' on Instance uuid a0f3832e-f300-4e35-b871-2f2c9dc4cc83 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:08:09.177092 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:09.180875 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:09.186438 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0718f76a-7692-4710-b14d-63f1e5a7c7d8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1229 microversion: 2.1 time: 0.109338 Sep 09 23:08:09.188240 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 334/680] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:09 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1229 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:09.635742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-821642302"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:09.636397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:09.643523 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:09.643943 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:09.644617 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:09.645310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:09.645763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:09.646312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:09.784849 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Adding security group 2be04b67-c3e8-47ee-b069-1eb2dcc7331b to port 279bf0ab-3755-42fc-a26c-13b4e5a027af Sep 09 23:08:10.094044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:10.094741 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:10.102715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:10.103209 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:10.103692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:10.104454 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:10.104914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:10.105344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:10.128647 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c8cb14b-7707-47cb-a21f-3c149f30cf0f tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "POST /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/action" status: 202 len: 0 microversion: 2.1 time: 0.497019 Sep 09 23:08:10.129339 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 347/681] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:08:09 2022] POST /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:08:10.137662 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:10.138345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:10.145370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:10.146144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:10.146677 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:10.148985 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:10.149659 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:10.150318 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:10.252928 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:10.261233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5f8fba90-3534-4ed6-a11f-6ef8e4e94d6b tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.171268 Sep 09 23:08:10.261907 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 335/682] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:10 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:10.268874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:10.269768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:10.281183 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:10.282049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:10.282544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:10.283482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:10.284075 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:10.284726 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:10.320969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:10.321627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:10.322224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:10.322670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lazy-loading 'fault' on Instance uuid a0f3832e-f300-4e35-b871-2f2c9dc4cc83 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:08:10.353991 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:10.367073 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78fb330d-69dc-495b-a081-f6ecfe9bb7ea tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1639 microversion: 2.1 time: 0.233291 Sep 09 23:08:10.378834 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 348/683] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:10 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1639 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:10.383837 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:10.398085 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3de194d1-0039-4338-820e-ce9a9f75b565 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 200 len: 1229 microversion: 2.1 time: 0.134871 Sep 09 23:08:10.399057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 336/684] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:10 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 1229 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:10.720232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ad20efb7-c28b-4222-b5bd-ad01776e1ced req-a4b692ac-b339-4b74-a3a8-02bf0e543a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b843e4fc-3be4-452c-a494-ac0093397048", "tag": "279bf0ab-3755-42fc-a26c-13b4e5a027af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:10.730116 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad20efb7-c28b-4222-b5bd-ad01776e1ced req-a4b692ac-b339-4b74-a3a8-02bf0e543a64 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:10.730601 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad20efb7-c28b-4222-b5bd-ad01776e1ced req-a4b692ac-b339-4b74-a3a8-02bf0e543a64 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:10.731038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad20efb7-c28b-4222-b5bd-ad01776e1ced req-a4b692ac-b339-4b74-a3a8-02bf0e543a64 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:10.742771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ad20efb7-c28b-4222-b5bd-ad01776e1ced req-a4b692ac-b339-4b74-a3a8-02bf0e543a64 service nova] Creating event network-changed:279bf0ab-3755-42fc-a26c-13b4e5a027af for instance b843e4fc-3be4-452c-a494-ac0093397048 on hv-cinder-85221 Sep 09 23:08:10.747935 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ad20efb7-c28b-4222-b5bd-ad01776e1ced req-a4b692ac-b339-4b74-a3a8-02bf0e543a64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031925 Sep 09 23:08:10.748651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 349/685] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:11.287421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:11.288247 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:11.294644 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:11.295123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:11.295586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:11.296277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:11.296731 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:11.297152 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:11.421584 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:11.422287 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:11.428358 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:11.429099 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:11.429540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:11.430232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:11.430687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:11.431113 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:11.444397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] HTTP exception thrown: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Request method failure captured: Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 HTTP/1.1 Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8ZZyLmnvWHQx1176xgyYPBbPDjUSvFr9-ug45Dza3VXeDiXZd7jxrtmrf614TFV0gucR9rtXZLn6akdNU4CeH7ldAbEp2L3EPfCiRnu36PDeU35ZNXlMLamsQs5H4R_UKpI8EeVFU5MZtpZZh8hzXQ84fuL9vI9CK3w5y-KNf8j0zw Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:08:11.446042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_82213ebf52f24af49758dd17e5e1d129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 3cbefab6dddb45c381158126d203f66b Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:08:11.447719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'a0f3832e-f300-4e35-b871-2f2c9dc4cc83'} Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:08:11.448678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:08:11.450175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:11.452468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Returning 404 to user: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:08:11.452468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49e8ce45-cb72-4add-8f94-19e70a475b4f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 404 len: 111 microversion: 2.1 time: 0.030065 Sep 09 23:08:11.452468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 350/686] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:11 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:08:11.549062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1854655295", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89000540", "security_groups": [{"name": "tempest-secgroup-smoke-2135557599"}], "block_device_mapping_v2": [{"uuid": "24601197-44aa-4886-a5fd-a8d2b6821906", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9445547a-ea9c-4c43-a619-716b862ad991"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:11.633455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:11.642563 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0c8204d-3dd3-4920-9b34-57d982a33738 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1522 microversion: 2.1 time: 0.359450 Sep 09 23:08:11.657901 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 337/687] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:11 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:11.673823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] validate_networks() for [('9445547a-ea9c-4c43-a619-716b862ad991', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:08:12.002632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b499c976-c377-412e-86ca-2e73be56b7b1 req-e54f1847-b690-4997-8f6b-9d406ceba180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645207f3-4aff-46ce-8998-aae640598f3b", "name": "network-vif-deleted", "tag": "47fb4751-46e9-49ab-8451-6f742ecce574"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:12.010720 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:12.015750 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b499c976-c377-412e-86ca-2e73be56b7b1 req-e54f1847-b690-4997-8f6b-9d406ceba180 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:12.016472 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b499c976-c377-412e-86ca-2e73be56b7b1 req-e54f1847-b690-4997-8f6b-9d406ceba180 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:12.017375 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b499c976-c377-412e-86ca-2e73be56b7b1 req-e54f1847-b690-4997-8f6b-9d406ceba180 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:12.031598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b499c976-c377-412e-86ca-2e73be56b7b1 req-e54f1847-b690-4997-8f6b-9d406ceba180 service nova] Creating event network-vif-deleted:47fb4751-46e9-49ab-8451-6f742ecce574 for instance 645207f3-4aff-46ce-8998-aae640598f3b on hv-cinder-85221 Sep 09 23:08:12.039266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b499c976-c377-412e-86ca-2e73be56b7b1 req-e54f1847-b690-4997-8f6b-9d406ceba180 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041744 Sep 09 23:08:12.040208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 338/688] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:08:12.126465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:08:12.126951 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:08:12.127360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:08:12.127917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:08:12.128336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:08:12.137832 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:12.138317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:12.138751 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:12.139535 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:12.140000 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:12.140427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:12.158239 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Getting quotas for project 82213ebf52f24af49758dd17e5e1d129. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:08:12.162320 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Getting quotas for user 3cbefab6dddb45c381158126d203f66b and project 82213ebf52f24af49758dd17e5e1d129. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:08:12.225926 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:08:12.228114 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24601197-44aa-4886-a5fd-a8d2b6821906',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:08:12.404084 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-96464488-d820-432a-9c26-a0ff105859bc tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.858772 Sep 09 23:08:12.405653 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 351/689] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:08:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:08:12.417440 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd73da62-126f-4f03-a4af-20afecb0ed55 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:12.417873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd73da62-126f-4f03-a4af-20afecb0ed55 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:12.461019 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:12.462284 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:12.470208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:12.470781 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:12.471314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:12.472098 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:12.472548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:12.472967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:12.492067 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd73da62-126f-4f03-a4af-20afecb0ed55 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:12.496831 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9afb2ce-19c9-46ff-a916-41b949c7ca40 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/ips" status: 200 len: 150 microversion: 2.1 time: 0.119348 Sep 09 23:08:12.497391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 339/690] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:08:12 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/ips => generated 150 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:12.501635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd73da62-126f-4f03-a4af-20afecb0ed55 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1093 microversion: 2.1 time: 0.088672 Sep 09 23:08:12.502270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 352/691] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:12 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:12.665715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:12.666333 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:12.672416 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:12.673093 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:12.673715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:12.674752 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:12.675857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:12.676434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:12.736650 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:12.737328 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:12.737921 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:12.738665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lazy-loading 'fault' on Instance uuid 645207f3-4aff-46ce-8998-aae640598f3b {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:08:12.801532 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24e6fb4c69d48f7b2972b53fb8ea4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688ef3e358c4822823707982fe4f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:12.812692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-64d8b715-5e43-4433-9ba9-8c50aed7d194 tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 200 len: 1312 microversion: 2.1 time: 0.150841 Sep 09 23:08:12.813269 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 340/692] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:12 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:13.525648 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:13.526256 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:13.532698 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:13.533178 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:13.533616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:13.534303 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:13.534758 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:13.535183 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:13.553214 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:13.597436 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:13.605019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43d2c3ef-7dd6-451b-b55a-b3e3134d26c6 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1191 microversion: 2.1 time: 0.083184 Sep 09 23:08:13.605771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 353/693] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:13 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:13.836865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:13.837510 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] [instance: 645207f3-4aff-46ce-8998-aae640598f3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:13.843877 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:13.844361 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:13.844802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:13.845490 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:13.845947 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:13.846377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:13.860110 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] HTTP exception thrown: Instance 645207f3-4aff-46ce-8998-aae640598f3b could not be found. Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Request method failure captured: Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b HTTP/1.1 Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YMi6ZzbmB27jSPQ1U4kf4RUObmjASl_OhA8mz0SjKjl4Vh6y6FTEgtBU3YAMjW_CZOA_TsB615F-OUgidE-l386CGo5SneVJLwHUryaBNIS55zAz5QWLzFIlEU36DefwbLD3JHo265zJDYosp2C6vCQJqVnQhrM-94DZktV4JCnn0 Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:08:13.861804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d688ef3e358c4822823707982fe4f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d688ef3e358c4822823707982fe4f654", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d688ef3e358c4822823707982fe4f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: d688ef3e358c4822823707982fe4f654 Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465593333 Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: e24e6fb4c69d48f7b2972b53fb8ea4a1 Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465593333-project Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 645207f3-4aff-46ce-8998-aae640598f3b could not be found. Sep 09 23:08:13.863396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '645207f3-4aff-46ce-8998-aae640598f3b'} Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645207f3-4aff-46ce-8998-aae640598f3b could not be found. Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:08:13.864368 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645207f3-4aff-46ce-8998-aae640598f3b could not be found. Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645207f3-4aff-46ce-8998-aae640598f3b could not be found. Sep 09 23:08:13.866004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:13.867938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] Returning 404 to user: Instance 645207f3-4aff-46ce-8998-aae640598f3b could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:08:13.875091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-784b2c5f-50f6-4c93-91e7-d112e5172afd tempest-ServerRescueNegativeTestJSON-465593333 tempest-ServerRescueNegativeTestJSON-465593333-project] 10.222.0.17 "GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b" status: 404 len: 111 microversion: 2.1 time: 0.041943 Sep 09 23:08:13.875903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 341/694] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:13 2022] GET /compute/v2.1/servers/645207f3-4aff-46ce-8998-aae640598f3b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:08:13.940609 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "213f905e-6cc5-4db7-8e70-32672ba53898"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:13.944173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:13.951165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:13.952491 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:13.953133 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:13.954042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:13.954567 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:13.955062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:14.448872 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dcd6bcf1-1a63-48cf-9b42-bc5e4159b942 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514152 Sep 09 23:08:14.456142 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 354/695] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:08:13 2022] POST /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:14.628639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:14.630648 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:14.637413 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:14.638353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:14.639103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:14.640069 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:14.640888 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:14.642262 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:14.745665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:14.754733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1398b5ac-579f-40cb-96a8-bb7c5271dd96 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1209 microversion: 2.1 time: 0.130186 Sep 09 23:08:14.755455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 342/696] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:14 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:15.716039 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5010dfd6-2d11-41da-bcaf-69f35d71f8ce req-939e321d-7707-4ff1-a293-745513578ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630c1ed5-3a51-4c57-86e9-b418f85887ee", "tag": "370eadb0-0d08-4853-b248-c2e6942c07c8"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:15.731348 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5010dfd6-2d11-41da-bcaf-69f35d71f8ce req-939e321d-7707-4ff1-a293-745513578ec2 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:15.733413 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5010dfd6-2d11-41da-bcaf-69f35d71f8ce req-939e321d-7707-4ff1-a293-745513578ec2 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:15.738710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5010dfd6-2d11-41da-bcaf-69f35d71f8ce req-939e321d-7707-4ff1-a293-745513578ec2 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:15.752789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5010dfd6-2d11-41da-bcaf-69f35d71f8ce req-939e321d-7707-4ff1-a293-745513578ec2 service nova] Creating event network-changed:370eadb0-0d08-4853-b248-c2e6942c07c8 for instance 630c1ed5-3a51-4c57-86e9-b418f85887ee on hv-cinder-85221 Sep 09 23:08:15.757446 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5010dfd6-2d11-41da-bcaf-69f35d71f8ce req-939e321d-7707-4ff1-a293-745513578ec2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057353 Sep 09 23:08:15.758049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 343/697] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:08:15.779637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:15.780339 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:15.785958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:15.786483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:15.786735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:15.787522 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:15.788144 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:15.789174 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:15.789718 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:15.789969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:15.790684 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:15.795774 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:15.796762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:15.797481 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:15.800741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:15.801478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:15.802187 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:15.833259 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b521bc2-77ac-4115-b7f1-4d2ba6bdbbbc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/ips" status: 200 len: 153 microversion: 2.20 time: 0.156956 Sep 09 23:08:15.835099 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 355/698] 10.222.0.17 () {60 vars in 1289 bytes} [Fri Sep 9 23:08:15 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/ips => generated 153 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:08:16.046228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:16.057997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-503a52ab-0641-4157-8fc8-b721e99cbaed tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.283337 Sep 09 23:08:16.058512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 344/699] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:15 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:17.081889 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:17.083238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:17.092613 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:17.093527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:17.094233 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:17.095166 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:17.095933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:17.096572 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:17.322119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:17.330682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a868d47f-2180-4cab-921e-2d52612e6b0b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.252610 Sep 09 23:08:17.332812 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 356/700] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:17 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:17.829361 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:17.829906 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:17.836308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:17.836790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:17.837226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:17.837917 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:17.838373 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:17.838793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:17.862673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lazy-loading 'flavor' on Instance uuid 479d8f15-a236-4cc4-835b-ddbb3ab4569b {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:08:18.057511 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af808773-1e39-4eec-af1e-13a4a1517f03 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/action" status: 202 len: 0 microversion: 2.20 time: 0.231839 Sep 09 23:08:18.061254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 345/701] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 9 23:08:17 2022] POST /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:08:18.068503 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:18.069236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:18.077919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:18.078688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:18.079345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:18.080123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:18.080722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:18.081974 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:18.217635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:18.225710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:18.227660 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:18.228814 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35185b59-8f2a-449a-ab5a-4c1272c0e589 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.165630 Sep 09 23:08:18.229561 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 357/702] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:18 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:18.355073 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:18.355808 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:18.362513 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:18.362992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:18.363419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:18.364129 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:18.364584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:18.365005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:18.505456 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:18.514686 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-acb3aec2-596a-436f-b17e-45fc98f0ac3b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.163228 Sep 09 23:08:18.515260 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 346/703] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:18 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:19.253823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:19.254433 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:19.260993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:19.261479 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:19.261914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:19.262606 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:19.263064 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:19.263512 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:19.425743 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:19.434431 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:19.435904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:19.437056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90b7eb14-fd37-445f-8994-4a682099312c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.187052 Sep 09 23:08:19.437719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 358/704] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:19 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:19.536746 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:19.537325 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:19.543968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:19.544450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:19.544878 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:19.545608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:19.546056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:19.546478 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:19.694135 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:19.702700 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a35096a-a194-42ce-b39a-8fd6677ade8e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.169828 Sep 09 23:08:19.703262 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 347/705] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:19 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:20.462218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:20.462934 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:20.470243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:20.470806 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:20.471241 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:20.471958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:20.472413 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:20.472860 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:20.611596 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:20.619931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:20.621370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:20.622562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50411ae1-96a5-4083-b1da-f4d2338c6567 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.164340 Sep 09 23:08:20.630000 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 359/706] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:20 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:20.726062 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:20.731738 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:20.738472 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:20.738953 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:20.739401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:20.740139 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:20.740599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:20.741179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:20.906214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:20.915105 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a11420d-b4dd-47d5-b0be-f28cdd1fe4ad tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.192565 Sep 09 23:08:20.915730 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 348/707] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:20 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:21.649245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:21.649995 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:21.657307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:21.657869 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:21.658377 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:21.659152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:21.659680 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:21.660115 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:21.797088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:21.805572 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:21.807001 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:21.808193 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a48edb21-679d-43c8-a21f-4b7fc3babd12 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.162951 Sep 09 23:08:21.808960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 360/708] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:21 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:08:21.939142 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:21.947913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:21.955371 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:21.955988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:21.956497 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:21.957300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:21.957968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:21.958499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:22.070904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "213f905e-6cc5-4db7-8e70-32672ba53898"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:22.073346 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:22.079882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:22.080363 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:22.080794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:22.081482 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:22.081934 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:22.082355 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:22.148395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:22.163388 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Invalid volume: volume 213f905e-6cc5-4db7-8e70-32672ba53898 is already attached to instances: a46f9130-09a3-430e-b22a-abc9830ed20f Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments HTTP/1.1 Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 74 Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:08:22.165149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {"volumeAttachment": {"volumeId": "213f905e-6cc5-4db7-8e70-32672ba53898"}} Sep 09 23:08:22.166752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Invalid volume: volume 213f905e-6cc5-4db7-8e70-32672ba53898 is already attached to instances: a46f9130-09a3-430e-b22a-abc9830ed20f Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'server_id': 'a46f9130-09a3-430e-b22a-abc9830ed20f', 'body': {'volumeAttachment': {'volumeId': '213f905e-6cc5-4db7-8e70-32672ba53898'}}} Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 213f905e-6cc5-4db7-8e70-32672ba53898 is already attached to instances: a46f9130-09a3-430e-b22a-abc9830ed20f Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:22.167579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 213f905e-6cc5-4db7-8e70-32672ba53898 is already attached to instances: a46f9130-09a3-430e-b22a-abc9830ed20f Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:22.168753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:22.170163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:22.170163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:08:22.170163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:08:22.170163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 213f905e-6cc5-4db7-8e70-32672ba53898 is already attached to instances: a46f9130-09a3-430e-b22a-abc9830ed20f Sep 09 23:08:22.170163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:08:22.170163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 400 to user: Invalid volume: volume 213f905e-6cc5-4db7-8e70-32672ba53898 is already attached to instances: a46f9130-09a3-430e-b22a-abc9830ed20f {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:08:22.170163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32e12c69-278d-44ea-97e5-616e6bde71e5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099701 Sep 09 23:08:22.170163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 361/709] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:08:22 2022] POST /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 23:08:22.203144 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:22.211204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf3d6aad-1b06-45f6-b423-cc73b8351416 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.276531 Sep 09 23:08:22.212000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 349/710] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:21 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:22.237371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:22.237899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:22.244009 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:22.244495 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:22.246350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:22.247263 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:22.248469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:22.249095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:22.353207 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lazy-loading 'services' on Instance uuid a46f9130-09a3-430e-b22a-abc9830ed20f {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:08:22.438957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-931184bc-b536-46ff-a4f4-793fd610a4dc tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments/213f905e-6cc5-4db7-8e70-32672ba53898" status: 202 len: 0 microversion: 2.1 time: 0.205241 Sep 09 23:08:22.442741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 362/711] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:08:22 2022] DELETE /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments/213f905e-6cc5-4db7-8e70-32672ba53898 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:08:22.452125 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:22.454480 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:22.461532 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:22.462079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:22.462520 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:22.463390 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:22.464131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:22.464797 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:22.501232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ddc0eaa-306a-41da-b717-2668bc82b2ba tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053288 Sep 09 23:08:22.501812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 350/712] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:08:22 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:08:22.831040 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:22.835763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:22.836466 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:22.843619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:22.844111 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:22.844551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:22.845249 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:22.845735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:22.846137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:23.010906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:23.020582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:23.022047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:23.024082 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-201ef0f5-49dc-4c6e-acb8-ee7fdf0fa7a8 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.194027 Sep 09 23:08:23.025003 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 363/713] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:22 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:23.240145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:23.241860 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:23.250102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:23.251412 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:23.252076 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:23.252974 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:23.254125 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:23.254775 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:23.283914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:23.479012 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:23.487802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36a9c44b-455e-498f-a2c6-adfdbce9ecd3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.254861 Sep 09 23:08:23.488386 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 351/714] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:23 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:23.514741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:23.517301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:23.524062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:23.524552 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:23.532233 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:23.532678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:23.533549 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:23.533783 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:23.568170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65ece61f-e17f-4476-b318-b172adbc5b51 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057881 Sep 09 23:08:23.569240 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 364/715] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:08:23 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:08:23.645402 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:23.645911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:23.651914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:23.652616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:23.653244 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:23.654097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:23.654751 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:23.655180 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:23.682401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:08:23.780143 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f32997e1-0211-441b-bad3-5818931d4551 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 204 len: 0 microversion: 2.1 time: 0.138239 Sep 09 23:08:23.781428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 352/716] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:08:23 2022] DELETE /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:08:23.789475 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:23.790288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:23.797029 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:23.797860 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:23.798454 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:23.799301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:23.799934 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:23.800513 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:24.003296 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:24.011268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55382625-05ef-4d74-be24-d872d0f8d2d9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1679 microversion: 2.1 time: 0.225613 Sep 09 23:08:24.011865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 365/717] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:23 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:24.055062 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:24.055796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:24.062255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:24.062601 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:24.063037 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:24.063760 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:24.064214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:24.064641 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:24.514422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:24.515049 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:24.520862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:24.521347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:24.521796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:24.522483 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:24.522924 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:24.523350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:24.546071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:24.556679 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:24.558279 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:24.559559 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b01b1b1e-db9c-4b03-b4ff-68dc2063f394 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.509138 Sep 09 23:08:24.560193 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 353/718] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:24 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:24.923308 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:24.931244 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0536ea2f-4e7e-416f-bee8-e763dae67ef5 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.423319 Sep 09 23:08:24.931840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 366/719] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:24 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:25.034267 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:25.034882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:25.041980 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:25.042472 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:25.042913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:25.043654 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:25.044294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:25.044728 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:25.183008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:25.192397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46557e34-a4d8-41cc-8550-671f3f29fe3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1679 microversion: 2.1 time: 0.162052 Sep 09 23:08:25.194674 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 354/720] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:25 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:25.493017 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8200e62a-4a49-4f41-9a14-a1af9ca7ce68 req-16bae98e-b867-4136-8431-7f46b08263c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630c1ed5-3a51-4c57-86e9-b418f85887ee", "name": "network-vif-plugged", "status": "completed", "tag": "370eadb0-0d08-4853-b248-c2e6942c07c8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:25.504526 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8200e62a-4a49-4f41-9a14-a1af9ca7ce68 req-16bae98e-b867-4136-8431-7f46b08263c4 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:25.505037 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8200e62a-4a49-4f41-9a14-a1af9ca7ce68 req-16bae98e-b867-4136-8431-7f46b08263c4 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:25.505465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8200e62a-4a49-4f41-9a14-a1af9ca7ce68 req-16bae98e-b867-4136-8431-7f46b08263c4 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:25.516835 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8200e62a-4a49-4f41-9a14-a1af9ca7ce68 req-16bae98e-b867-4136-8431-7f46b08263c4 service nova] Creating event network-vif-plugged:370eadb0-0d08-4853-b248-c2e6942c07c8 for instance 630c1ed5-3a51-4c57-86e9-b418f85887ee on hv-cinder-85221 Sep 09 23:08:25.521795 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8200e62a-4a49-4f41-9a14-a1af9ca7ce68 req-16bae98e-b867-4136-8431-7f46b08263c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182456 Sep 09 23:08:25.522579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 367/721] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:25.585997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:25.586661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:25.593286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:25.593771 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:25.594205 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:25.594958 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:25.595408 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:25.595850 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:25.823655 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:25.834170 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:25.836046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:25.837362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40d06970-6c13-47e8-aa20-39d4e2d0f0b3 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.255362 Sep 09 23:08:25.843666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 355/722] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:25 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:25.954854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:25.955724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:25.962908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:25.963436 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:25.963900 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:25.964601 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:25.965066 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:25.965607 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:26.115279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:26.123455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c375ec60-f3c2-45f2-92f9-8a980c8f3e81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.172963 Sep 09 23:08:26.131587 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 368/723] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:25 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:26.219003 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:26.219842 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:26.226194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:26.226763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:26.227266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:26.228196 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:26.228717 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:26.229208 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:26.441352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:26.450265 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1eec4470-05c5-45db-b8a8-4c550cdcba3b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1679 microversion: 2.1 time: 0.235998 Sep 09 23:08:26.458213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 356/724] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:26 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:26.762576 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-fb5595c3-3e0f-4ce4-9e54-d0e7eb33bd82 req-fa7d20e6-522b-4a98-b652-a31783385c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46f9130-09a3-430e-b22a-abc9830ed20f", "name": "network-vif-deleted", "tag": "9464c26e-5e5a-4ad0-a8c8-bcce743a6ac0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:26.782635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fb5595c3-3e0f-4ce4-9e54-d0e7eb33bd82 req-fa7d20e6-522b-4a98-b652-a31783385c60 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:26.783579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fb5595c3-3e0f-4ce4-9e54-d0e7eb33bd82 req-fa7d20e6-522b-4a98-b652-a31783385c60 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:26.784397 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fb5595c3-3e0f-4ce4-9e54-d0e7eb33bd82 req-fa7d20e6-522b-4a98-b652-a31783385c60 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:26.790516 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:26.800229 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fb5595c3-3e0f-4ce4-9e54-d0e7eb33bd82 req-fa7d20e6-522b-4a98-b652-a31783385c60 service nova] Creating event network-vif-deleted:9464c26e-5e5a-4ad0-a8c8-bcce743a6ac0 for instance a46f9130-09a3-430e-b22a-abc9830ed20f on hv-cinder-85221 Sep 09 23:08:26.806328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-fb5595c3-3e0f-4ce4-9e54-d0e7eb33bd82 req-fa7d20e6-522b-4a98-b652-a31783385c60 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050424 Sep 09 23:08:26.807204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 369/725] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:26.863472 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:26.864891 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:26.871763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:26.872690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:26.873494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:26.874583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:26.875335 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:26.875955 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:27.096626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:27.105088 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:27.106826 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:27.108179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a14e443d-df9c-42d2-86f0-4d47bd026273 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.249367 Sep 09 23:08:27.108825 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 357/726] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:26 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:27.147625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:27.148602 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:27.155137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:27.155963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:27.156620 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:27.157544 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:27.158238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:27.159042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:27.312620 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:27.320731 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b087b3b-0ace-440b-8f07-ca0639e57618 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1265 microversion: 2.1 time: 0.177786 Sep 09 23:08:27.321503 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 370/727] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:27 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:27.476884 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:27.478909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:27.485903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:27.486517 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:27.487063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:27.487911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:27.488480 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:27.489007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:27.527317 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:27.527981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:27.528603 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:27.529191 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lazy-loading 'fault' on Instance uuid a46f9130-09a3-430e-b22a-abc9830ed20f {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:08:27.599263 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:27.611409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8a607cb-8034-4fa9-89a9-33c5fc32e634 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 200 len: 1328 microversion: 2.1 time: 0.139082 Sep 09 23:08:27.612289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 358/728] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:27 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:28.134114 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:28.134758 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:28.142953 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:28.143439 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:28.143898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:28.144606 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:28.145042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:28.145656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:28.284893 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:28.292922 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:28.294446 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:28.295847 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0f2add1-5b1f-4b76-bd66-7b3c7dcd1292 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.165632 Sep 09 23:08:28.296386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 371/729] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:28 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:28.344697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:28.345308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:28.351576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:28.352060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:28.352489 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:28.353180 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:28.353629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:28.354054 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:28.490413 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:28.498131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5f0cb4d-3e2b-42f2-896f-daaeba26ad24 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1453 microversion: 2.1 time: 0.157806 Sep 09 23:08:28.498682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 359/730] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:28 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:28.521022 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:28.521743 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:28.527865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:28.528354 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:28.528793 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:28.530108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:28.530568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:28.530999 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:28.636765 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:28.637386 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:28.644118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:28.644609 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:28.645331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:28.646303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:28.646785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:28.647615 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:28.661605 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f HTTP/1.1 Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:08:28.663659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:08:28.665000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'a46f9130-09a3-430e-b22a-abc9830ed20f'} Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:08:28.665787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:08:28.667116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:08:28.668237 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:08:28.668313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:28.671889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4c59b4f-e74b-485d-9e5b-90fe5c675851 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 404 len: 111 microversion: 2.1 time: 0.032416 Sep 09 23:08:28.672848 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 360/731] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:28 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:08:28.676644 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da42ef7b-a10c-473d-90c8-58b3e6dba92e tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1453 microversion: 2.1 time: 0.159570 Sep 09 23:08:28.677484 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 372/732] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:28 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:28.681137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1033e29-574d-4b9e-b556-edb23151b828 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '.version_select at 0x7fcecf4a8b80>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:28.702191 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1033e29-574d-4b9e-b556-edb23151b828 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309658698" status: 202 len: 0 microversion: 2.1 time: 0.025186 Sep 09 23:08:28.702890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 361/733] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 9 23:08:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309658698 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:08:29.321719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:29.322330 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:29.334525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:29.335026 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:29.335473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:29.336204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:29.336660 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:29.337085 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:29.413312 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-065c56f2-ddc2-489d-931b-8d18267f0ff4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: .version_select at 0x7fcecf264310>, body: {"keypair": {"name": "tempest-keypair-1452235589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWHUrPNQkAAzOFuEAteB2tph9bbwp107+a1VvCSpooGf0ezxnHhtA5tpD85aX4xYme7OwzCGiUbqvvVVZ2eg67RUQkcvHEmNiZPd0O98Lszl+v7fA/pt8InomrZPKIsFA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:29.432193 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-065c56f2-ddc2-489d-931b-8d18267f0ff4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for project cba38c443abf49a48bdb55f42dac68b0. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:08:29.437101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-065c56f2-ddc2-489d-931b-8d18267f0ff4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for user 85cd8a90230b4c69886534be67acd943 and project cba38c443abf49a48bdb55f42dac68b0. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:08:29.468507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-065c56f2-ddc2-489d-931b-8d18267f0ff4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059562 Sep 09 23:08:29.469386 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 362/734] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:08:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:29.558154 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:29.566901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:29.568764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:29.570311 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aaf0271b-48ae-4e00-b8a0-ec6eadd36b4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.252670 Sep 09 23:08:29.584763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 373/735] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:29 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:30.596843 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:30.597474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:30.603818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:30.604566 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:30.605049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:30.605709 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:30.606375 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:30.606810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:30.815532 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:30.829030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:30.831201 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:30.832982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f842596a-eeae-4ec9-b816-749dc0b5bc99 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.240527 Sep 09 23:08:30.834150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 363/736] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:30 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:30.925243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1997751893", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1317db-d467-415d-ab18-3336278fd50c"}], "security_groups": [{"name": "tempest-securitygroup--1997727267"}], "key_name": "tempest-keypair-1452235589", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:31.006916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9f10bfd1-5a8c-4311-8ece-0fde66b7e382 req-f3d7a17a-716e-41c0-97d4-1bf421f9a7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630c1ed5-3a51-4c57-86e9-b418f85887ee", "tag": "370eadb0-0d08-4853-b248-c2e6942c07c8"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:31.018610 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f10bfd1-5a8c-4311-8ece-0fde66b7e382 req-f3d7a17a-716e-41c0-97d4-1bf421f9a7c2 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:31.019361 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f10bfd1-5a8c-4311-8ece-0fde66b7e382 req-f3d7a17a-716e-41c0-97d4-1bf421f9a7c2 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:31.019978 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f10bfd1-5a8c-4311-8ece-0fde66b7e382 req-f3d7a17a-716e-41c0-97d4-1bf421f9a7c2 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:31.035267 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9f10bfd1-5a8c-4311-8ece-0fde66b7e382 req-f3d7a17a-716e-41c0-97d4-1bf421f9a7c2 service nova] Creating event network-changed:370eadb0-0d08-4853-b248-c2e6942c07c8 for instance 630c1ed5-3a51-4c57-86e9-b418f85887ee on hv-cinder-85221 Sep 09 23:08:31.041131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9f10bfd1-5a8c-4311-8ece-0fde66b7e382 req-f3d7a17a-716e-41c0-97d4-1bf421f9a7c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038533 Sep 09 23:08:31.047635 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 364/737] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:08:31.048924 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] validate_networks() for [('2c1317db-d467-415d-ab18-3336278fd50c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:08:31.514534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:08:31.515306 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:08:31.516212 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:08:31.517377 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:08:31.518269 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:08:31.528221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:31.529364 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:31.530072 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:31.531008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:31.531733 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:31.532260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:31.551001 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for project cba38c443abf49a48bdb55f42dac68b0. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:08:31.555732 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Getting quotas for user 85cd8a90230b4c69886534be67acd943 and project cba38c443abf49a48bdb55f42dac68b0. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:08:31.567863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:08:31.570157 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:08:31.646675 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a8d1e1e-1971-46c6-87fe-3826126e3e7a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.730801 Sep 09 23:08:31.649249 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 374/738] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:08:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:08:31.660562 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29f0c910-efe1-425d-b161-7ca562ffd77b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:31.661978 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29f0c910-efe1-425d-b161-7ca562ffd77b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:31.774899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29f0c910-efe1-425d-b161-7ca562ffd77b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:31.784851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29f0c910-efe1-425d-b161-7ca562ffd77b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1242 microversion: 2.1 time: 0.129259 Sep 09 23:08:31.799556 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 365/739] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:31 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:31.858897 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:31.859521 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:31.866608 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:31.867092 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:31.867537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:31.868242 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:31.868688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:31.869108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:32.072998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:32.084235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:32.086043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:32.087503 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3168b6c-d58e-4e8b-8da0-68ba6b90568a tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.233279 Sep 09 23:08:32.088177 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 375/740] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:31 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:32.708922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:32.710792 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:32.719207 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:32.719720 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:32.720152 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:32.720852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:32.721299 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:32.721716 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:32.794119 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88eed60e-41db-421b-87f4-e7fa8b060e6c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "POST /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/action" status: 202 len: 0 microversion: 2.1 time: 0.089012 Sep 09 23:08:32.797809 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 366/741] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:08:32 2022] POST /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:08:32.802981 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:32.803970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:32.810340 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:32.810901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:32.811013 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:32.811452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:32.811904 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:32.812288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:32.812821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:32.813303 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:32.820060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:32.820665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:32.821176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:32.821989 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:32.822637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:32.823236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:32.897714 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:32.908862 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b8a529f-16d8-44db-8b39-7db474a48c00 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1294 microversion: 2.1 time: 0.102074 Sep 09 23:08:32.909762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 367/742] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:32 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:33.010306 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:33.020839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d748798c-ac3c-4476-b2d5-76ac9dc9f5ff tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1749 microversion: 2.1 time: 0.221644 Sep 09 23:08:33.027949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 376/743] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:32 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1749 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:33.120045 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:33.121685 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:33.129164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:33.129512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:33.130006 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:33.130711 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:33.131169 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:33.131620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:33.522702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:33.538122 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:33.540089 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:33.541302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-663930ae-537e-447d-8f46-1fcde914a5ad tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.429255 Sep 09 23:08:33.542028 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 368/744] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:33 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:33.933763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:33.934442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:33.940548 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:33.941102 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:33.941600 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:33.942356 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:33.942892 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:33.943381 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:34.013505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:34.024764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63c44e66-fdf2-4899-960d-d182716a9586 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1300 microversion: 2.1 time: 0.094474 Sep 09 23:08:34.025716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 377/745] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:33 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:34.056660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:34.057276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:34.064462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:34.065189 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:34.065692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:34.066584 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:34.067042 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:34.067468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:34.083362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:34.553626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:34.566074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c77e7b0-6f0e-40d1-a542-affa0826f705 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1749 microversion: 2.1 time: 0.513897 Sep 09 23:08:34.566845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:34.567558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 369/746] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:34 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1749 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:34.573690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:34.584954 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:34.585635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:34.586273 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:34.587805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:34.588424 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:34.588858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:34.750952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:34.764817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:34.766820 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:34.768258 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-defdb5b9-b7d7-407b-ba4b-b41bf3c4d262 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1746 microversion: 2.20 time: 0.205830 Sep 09 23:08:34.780140 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 378/747] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:34 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:08:35.051025 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:35.051667 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:35.064155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:35.065444 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:35.065879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:35.066827 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:35.067447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:35.067919 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:35.219044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:35.228829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9341f7df-3884-4c71-8bd9-505e2b36f612 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.181851 Sep 09 23:08:35.229414 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 370/748] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:35 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:35.590380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:35.591734 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:35.602303 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:35.603773 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:35.604450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:35.607794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:35.607947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:35.608323 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:35.796378 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:35.797454 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:35.810791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:35.812423 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:35.813763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:35.815902 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:35.816201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:35.818267 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:35.820526 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:35.824834 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28f75273-128e-4b0d-8638-8661679cecdf tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.238345 Sep 09 23:08:35.826716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 379/749] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:35 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:36.085183 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:36.098421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:36.100357 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:36.101544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4feb5caa-bd4f-404d-9938-1e853c1ec724 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.309755 Sep 09 23:08:36.102342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 371/750] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:35 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:08:36.237565 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-963c9355-27b6-462c-a956-2aca0270107e req-d333fd54-63a6-4fb0-8b98-2de7cd968724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7be666-57e9-4a77-babb-e86eebc9856b", "tag": "ac3a34e4-9d78-4dcb-bf8b-165c55063398"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:36.253855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:36.255224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:36.258826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-963c9355-27b6-462c-a956-2aca0270107e req-d333fd54-63a6-4fb0-8b98-2de7cd968724 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:36.259326 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-963c9355-27b6-462c-a956-2aca0270107e req-d333fd54-63a6-4fb0-8b98-2de7cd968724 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:36.261957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-963c9355-27b6-462c-a956-2aca0270107e req-d333fd54-63a6-4fb0-8b98-2de7cd968724 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:36.267086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:36.267992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:36.268702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:36.269671 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:36.270325 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:36.271087 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:36.285366 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-963c9355-27b6-462c-a956-2aca0270107e req-d333fd54-63a6-4fb0-8b98-2de7cd968724 service nova] Creating event network-changed:ac3a34e4-9d78-4dcb-bf8b-165c55063398 for instance 7b7be666-57e9-4a77-babb-e86eebc9856b on hv-cinder-85221 Sep 09 23:08:36.290567 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-963c9355-27b6-462c-a956-2aca0270107e req-d333fd54-63a6-4fb0-8b98-2de7cd968724 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056508 Sep 09 23:08:36.291186 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 380/751] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:36.529284 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:36.581347 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4c0bf97-b4e2-4244-ad39-04a73c121a3a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.332718 Sep 09 23:08:36.582144 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 372/752] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:36 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:36.856293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:36.858346 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:36.870858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:36.871903 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:36.872709 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:36.873794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:36.874498 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:36.875598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:37.119974 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:37.132565 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e14feee6-1d1e-432b-9c6b-ca80afa9efba tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.282189 Sep 09 23:08:37.133990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:37.134873 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:37.135091 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 381/753] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:36 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:37.143246 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:37.144044 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:37.144665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:37.145569 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:37.146430 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:37.147049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:37.407048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:37.444930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:37.448788 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:37.450225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-15dc3209-03ad-48db-a587-c2b39bbd9ef9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.320693 Sep 09 23:08:37.451799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 373/754] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:37 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:37.502145 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-48f37099-7f13-4501-a687-93f7076050b4 req-e2351b5f-2fcc-41ef-835c-f49bfcc827be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479d8f15-a236-4cc4-835b-ddbb3ab4569b", "name": "network-vif-plugged", "status": "completed", "tag": "194395d4-13f2-4287-a338-5cc41afb196d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:37.512866 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-48f37099-7f13-4501-a687-93f7076050b4 req-e2351b5f-2fcc-41ef-835c-f49bfcc827be service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:37.513821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-48f37099-7f13-4501-a687-93f7076050b4 req-e2351b5f-2fcc-41ef-835c-f49bfcc827be service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:37.514263 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-48f37099-7f13-4501-a687-93f7076050b4 req-e2351b5f-2fcc-41ef-835c-f49bfcc827be service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:37.535920 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-48f37099-7f13-4501-a687-93f7076050b4 req-e2351b5f-2fcc-41ef-835c-f49bfcc827be service nova] Creating event network-vif-plugged:194395d4-13f2-4287-a338-5cc41afb196d for instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b on hv-cinder-85221 Sep 09 23:08:37.544294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-48f37099-7f13-4501-a687-93f7076050b4 req-e2351b5f-2fcc-41ef-835c-f49bfcc827be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045787 Sep 09 23:08:37.546464 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 382/755] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:37.608373 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:37.609393 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:37.616020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:37.616482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:37.617245 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:37.618042 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:37.618570 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:37.619185 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:37.801004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:37.809276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5b76e1b-93b8-4211-a0a7-45d9d3ecd20c tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.207845 Sep 09 23:08:37.810476 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 374/756] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:37 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:38.160724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:38.162100 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:38.172540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:38.173307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:38.173926 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:38.174798 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:38.175413 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:38.176011 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:38.381803 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:38.394175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-08e8c329-390f-4d37-a432-c1054172269b tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.239137 Sep 09 23:08:38.395250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 383/757] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:38 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:38.481405 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:38.482702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:38.492621 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:38.495384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:38.496075 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:38.496966 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:38.500217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:38.500847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:38.836583 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:38.837509 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:38.844919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:38.845667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:38.846327 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:38.847260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:38.847980 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:38.848673 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:39.035964 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:39.045177 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:39.048318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:39.049798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53ccce48-f312-4345-83c2-6aa5210e7cc4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.572703 Sep 09 23:08:39.050474 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 375/758] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:38 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:39.061495 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:39.069689 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09320744-d1b6-42e7-be50-974ae753e3c5 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.237391 Sep 09 23:08:39.070293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 384/759] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:38 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:39.423645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:39.424602 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:39.427477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:39.433282 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:39.434222 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:39.435097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:39.436508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:39.437184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:39.437618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:39.621959 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:39.630319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c88832c-5e90-4ed9-97b5-ece514b05e2d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.211694 Sep 09 23:08:39.630893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 376/760] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:39 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:40.077826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:40.078807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:40.085653 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:40.086145 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:40.086638 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:40.088749 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:40.088749 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:40.088749 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:40.103942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:40.104662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:40.112681 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:40.113426 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:40.113947 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:40.114733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:40.115660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:40.116178 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:40.257118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:40.264738 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:40.266299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:40.268236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:40.269461 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af4d9f0e-72f5-4b59-977c-03a869be5c66 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.195672 Sep 09 23:08:40.270250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 385/761] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:40 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:40.273111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2bf03c90-a563-47a9-b9ec-eb398175dd06 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.182642 Sep 09 23:08:40.273671 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 377/762] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:40 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:40.654698 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:40.655933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:40.664152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:40.664960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:40.665647 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:40.666659 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:40.667312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:40.667956 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:40.826899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:40.835297 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ca448d8-b190-4a66-9657-055577ccb7c1 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.184914 Sep 09 23:08:40.841843 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 386/763] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:40 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:41.297101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:41.298261 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:41.300611 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:41.305727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:41.306609 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:41.307390 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:41.308069 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:41.308977 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:41.309620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:41.310608 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:41.318866 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:41.319987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:41.321230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:41.322019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:41.322609 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:41.323106 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:41.488219 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:41.498278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d956445-6a06-46d7-b3a9-3066b7470b45 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.201781 Sep 09 23:08:41.513818 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 387/764] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:41 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:41.514039 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:41.514039 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:41.514709 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:41.516243 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df967b9c-0a53-4ef7-b366-6b0f8ba83b76 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.224382 Sep 09 23:08:41.516899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 378/765] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:41 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:41.860177 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:41.860862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:41.864004 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:41.864775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:41.869286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:41.869777 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:41.870217 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:41.871069 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:41.871557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:41.871991 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:41.892402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:42.038439 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:42.049868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a446f2ed-dbe2-4d06-8d13-cb375e4a5d91 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.193628 Sep 09 23:08:42.062246 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 388/766] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:41 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:42.524413 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:42.525993 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:42.530172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:42.540889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:42.542870 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:42.544170 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:42.545002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:42.545735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:42.546365 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:42.546851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:42.547288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:42.572189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:42.572189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:42.572189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:42.572189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:42.572681 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:42.572681 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:42.764973 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:42.776227 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cdd3aa37-1c94-4748-9fed-76fa692f011e tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.257312 Sep 09 23:08:42.777611 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 379/767] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:42 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:42.814519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:42.823625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:42.825173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:42.826553 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83600c26-cdf8-4a84-bd7f-b954d7e3271f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.288002 Sep 09 23:08:42.827190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 389/768] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:42 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:43.073849 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:43.074973 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:43.081383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:43.082104 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:43.082761 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:43.083453 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:43.083927 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:43.087088 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:43.235658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:43.244042 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8e2478b-d32c-44ae-b0fa-ac114e83c479 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.174271 Sep 09 23:08:43.245121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 380/769] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:43 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:43.701518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-84ef89f2-6d92-4bdb-9562-8055327bb9ec req-9c5c702d-cba8-4992-a357-d05e1827bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7be666-57e9-4a77-babb-e86eebc9856b", "name": "network-vif-plugged", "status": "completed", "tag": "ac3a34e4-9d78-4dcb-bf8b-165c55063398"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:43.738963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-84ef89f2-6d92-4bdb-9562-8055327bb9ec req-9c5c702d-cba8-4992-a357-d05e1827bcd0 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:43.739548 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-84ef89f2-6d92-4bdb-9562-8055327bb9ec req-9c5c702d-cba8-4992-a357-d05e1827bcd0 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:43.740359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-84ef89f2-6d92-4bdb-9562-8055327bb9ec req-9c5c702d-cba8-4992-a357-d05e1827bcd0 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:43.761106 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-84ef89f2-6d92-4bdb-9562-8055327bb9ec req-9c5c702d-cba8-4992-a357-d05e1827bcd0 service nova] Creating event network-vif-plugged:ac3a34e4-9d78-4dcb-bf8b-165c55063398 for instance 7b7be666-57e9-4a77-babb-e86eebc9856b on hv-cinder-85221 Sep 09 23:08:43.770613 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-84ef89f2-6d92-4bdb-9562-8055327bb9ec req-9c5c702d-cba8-4992-a357-d05e1827bcd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076519 Sep 09 23:08:43.771910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 390/770] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:43.799305 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:43.800079 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:43.807239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:43.807740 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:43.808331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:43.809041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:43.809566 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:43.810555 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:43.859642 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:43.864286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:43.879158 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:43.879819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:43.880519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:43.881484 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:43.882112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:43.883971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:44.083044 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:44.096781 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:44.098972 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:44.100667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe93424f-3387-4d73-8525-08811644c576 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.249742 Sep 09 23:08:44.101883 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 391/771] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:43 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:44.116299 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:44.125422 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-853f7610-ea90-4b3c-a663-7472a4b93faa tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.329928 Sep 09 23:08:44.126403 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 381/772] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:43 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:44.267886 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:44.268503 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:44.276647 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:44.277135 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:44.277601 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:44.278305 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:44.278873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:44.279298 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:44.434958 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:44.446899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b2292c4b-547b-4ecb-a83e-b1745b18a5fc tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.181648 Sep 09 23:08:44.449695 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 392/773] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:44 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:45.127233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:45.127930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:45.136391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:45.137065 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:45.137683 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:45.138916 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:45.139555 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:45.140152 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:45.152677 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:45.153286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:45.159809 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:45.160295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:45.160730 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:45.161423 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:45.161879 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:45.162301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:45.290842 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:45.312117 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:45.317533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:45.320212 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:45.321545 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-212bc2ae-0b33-40fc-b839-d95b428f1670 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.198173 Sep 09 23:08:45.326341 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-635b6873-9e5d-4bc5-92bd-82f3bba45283 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.180090 Sep 09 23:08:45.327313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 393/774] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:45 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:45.340006 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 382/775] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:45 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:45.470749 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:45.471464 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:45.477582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:45.478064 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:45.478494 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:45.479178 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:45.479655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:45.480074 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:45.641103 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:45.651396 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1028ea25-51e1-43db-a10f-3336a5171ea7 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.184435 Sep 09 23:08:45.652431 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 394/776] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:45 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:46.350078 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:46.350992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:46.358026 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:46.358761 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:46.359428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:46.360228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:46.360924 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:46.361435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:46.374014 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:46.375283 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:46.384429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:46.385067 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:46.385745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:46.386550 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:46.387142 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:46.387766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:46.520412 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:46.528572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd8b0e58-198a-447b-8e84-083af3ad7fb4 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.182374 Sep 09 23:08:46.529486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 383/777] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:46 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:46.553190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:46.562841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:46.564459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:46.565784 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c21d4894-efde-4c1f-b9e2-f8ccc5ac528e tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.196830 Sep 09 23:08:46.566446 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 395/778] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:46 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:08:46.676325 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:46.676938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:46.683009 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:46.683500 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:46.683946 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:46.684632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:46.685107 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:46.685534 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:46.828963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:46.837087 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1911fdb5-6f94-49ee-b679-0dd887a5b56e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.164688 Sep 09 23:08:46.837652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 384/779] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:46 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:47.552874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:47.553478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:47.556225 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:47.561972 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:47.562464 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:47.562897 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:47.563614 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:47.564067 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:47.564491 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:47.591720 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:47.592429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:47.598765 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:47.599312 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:47.599847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:47.600636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:47.601150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:47.601635 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:47.696852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:47.704554 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18bc7003-8990-4d7f-9a2e-5ad2ead18edd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1368 microversion: 2.1 time: 0.155709 Sep 09 23:08:47.705299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 396/780] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:47 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:47.737005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:47.740405 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:47.745929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:47.747376 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:47.748558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-098248d0-8ae2-479e-a4b0-54e332cb6ac0 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1741 microversion: 2.20 time: 0.161373 Sep 09 23:08:47.749118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 385/781] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:47 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:08:47.860625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:47.861170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:47.867036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:47.867538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:47.867978 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:47.868661 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:47.869116 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:47.869539 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:48.009242 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:48.017949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0bb2c06b-92e4-48da-b7ac-d360f12d0ea6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.161202 Sep 09 23:08:48.018521 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 397/782] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:47 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:48.728081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:48.728692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:48.735724 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:48.736213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:48.736651 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:48.737344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:48.737804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:48.738228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:48.774116 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:48.774731 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:48.780689 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:48.781172 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:48.781603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:48.782325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:48.782779 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:48.783204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:48.866767 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:48.874960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db71cb91-0b95-4403-a3d9-6c805568d3ff tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1558 microversion: 2.1 time: 0.150934 Sep 09 23:08:48.875542 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 386/783] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:48 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:48.897575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:48.898063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:48.904435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:48.904915 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:48.905352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:48.906039 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:48.906494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:48.907094 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:48.915984 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:48.925184 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:48.926719 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:48.928173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-affc1217-2f75-4a2c-829e-4c3088ebd2df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1723 microversion: 2.20 time: 0.158007 Sep 09 23:08:48.928977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 398/784] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:48 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:08:48.991149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4319e21-b0d7-4bba-9d84-6f3b672d820d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097577 Sep 09 23:08:48.991768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 387/785] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 23:08:48 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:08:49.041707 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:49.042407 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:49.049178 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:49.049666 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:49.050204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:49.050939 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:49.051416 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:49.051872 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:49.201496 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:49.210109 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df26b4d8-243e-4278-8295-d530fe7ee69d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.172289 Sep 09 23:08:49.210794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 399/786] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:49 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:49.954725 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:49.955437 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:49.962188 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:49.962609 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:49.963049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:49.963797 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:49.964251 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:49.964678 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:50.179677 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:50.189165 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:50.190791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:50.191985 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-537647a4-24c0-4127-a3db-f8ba2628973d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1723 microversion: 2.20 time: 0.242109 Sep 09 23:08:50.192547 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 388/787] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:49 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:50.235246 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:50.236278 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:50.244646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:50.245130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:50.245568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:50.246258 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:50.246707 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:50.247868 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:50.395696 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:50.404499 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-226881ea-edb2-4ec7-b59c-0cf466d5ebc6 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.174099 Sep 09 23:08:50.405077 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 400/788] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:50 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:50.442496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-aa3282d6-1b8c-4ba8-88cc-e64419f36ef3 req-b810047f-a24c-47fe-ae18-772638ca3d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7be666-57e9-4a77-babb-e86eebc9856b", "tag": "ac3a34e4-9d78-4dcb-bf8b-165c55063398"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:50.451907 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aa3282d6-1b8c-4ba8-88cc-e64419f36ef3 req-b810047f-a24c-47fe-ae18-772638ca3d50 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:50.452382 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aa3282d6-1b8c-4ba8-88cc-e64419f36ef3 req-b810047f-a24c-47fe-ae18-772638ca3d50 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:50.452812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aa3282d6-1b8c-4ba8-88cc-e64419f36ef3 req-b810047f-a24c-47fe-ae18-772638ca3d50 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:50.463467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-aa3282d6-1b8c-4ba8-88cc-e64419f36ef3 req-b810047f-a24c-47fe-ae18-772638ca3d50 service nova] Creating event network-changed:ac3a34e4-9d78-4dcb-bf8b-165c55063398 for instance 7b7be666-57e9-4a77-babb-e86eebc9856b on hv-cinder-85221 Sep 09 23:08:50.469147 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-aa3282d6-1b8c-4ba8-88cc-e64419f36ef3 req-b810047f-a24c-47fe-ae18-772638ca3d50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030312 Sep 09 23:08:50.469743 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 389/789] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:51.217714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:51.218235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:51.224359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:51.224851 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:51.225285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:51.226136 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:51.226474 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:51.226908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:51.364539 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:51.373447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:51.375081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:51.376271 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2efdda9e-07cb-4fd1-b186-8277e5430b17 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1723 microversion: 2.20 time: 0.162573 Sep 09 23:08:51.377089 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 401/790] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:51 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:51.429581 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:51.430285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:51.437573 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:51.438058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:51.438487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:51.439180 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:51.439658 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:51.440076 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:51.593847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:51.602726 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e22cae13-9e64-45b5-86bf-b7ec68fbe54d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.177776 Sep 09 23:08:51.603300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 390/791] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:51 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:52.402179 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:52.402852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:52.409945 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:52.410428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:52.410862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:52.411573 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:52.412036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:52.412462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:52.628876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:52.629600 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:52.636277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:52.636904 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:52.637194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:52.638494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:52.638948 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:52.639374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:52.688639 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:52.696828 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:52.698280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:52.699463 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa3fff51-d097-4d26-8de0-075a13659b98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1723 microversion: 2.20 time: 0.301234 Sep 09 23:08:52.700046 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 402/792] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:52 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:53.041553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:53.050068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99d36c5f-a3df-4870-8cc9-d04cb6c091f3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.425154 Sep 09 23:08:53.051222 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 391/793] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:52 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:53.725196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:53.725753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:53.732878 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:53.733368 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:53.734007 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:53.734486 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:53.734944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:53.735371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:53.864485 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:53.872650 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:53.874086 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:53.875246 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43293370-2b29-472d-9ea8-246430a19c24 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1723 microversion: 2.20 time: 0.154140 Sep 09 23:08:53.875827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 403/794] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:53 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:53.931076 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-708b573c-1973-4adc-a9d3-b7e10b26bb0e req-6941507f-5e9d-4156-9622-a112a3a8d80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479d8f15-a236-4cc4-835b-ddbb3ab4569b", "name": "network-vif-unplugged", "status": "completed", "tag": "194395d4-13f2-4287-a338-5cc41afb196d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:53.942483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-708b573c-1973-4adc-a9d3-b7e10b26bb0e req-6941507f-5e9d-4156-9622-a112a3a8d80f service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:53.942965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-708b573c-1973-4adc-a9d3-b7e10b26bb0e req-6941507f-5e9d-4156-9622-a112a3a8d80f service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:53.943397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-708b573c-1973-4adc-a9d3-b7e10b26bb0e req-6941507f-5e9d-4156-9622-a112a3a8d80f service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:53.955122 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-708b573c-1973-4adc-a9d3-b7e10b26bb0e req-6941507f-5e9d-4156-9622-a112a3a8d80f service nova] Creating event network-vif-unplugged:194395d4-13f2-4287-a338-5cc41afb196d for instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b on hv-cinder-85221 Sep 09 23:08:53.960628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-708b573c-1973-4adc-a9d3-b7e10b26bb0e req-6941507f-5e9d-4156-9622-a112a3a8d80f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033595 Sep 09 23:08:53.961227 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 392/795] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:08:54.073567 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:54.074184 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:54.080536 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:54.081020 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:54.081456 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:54.082156 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:54.082613 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:54.083044 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:54.226204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:54.234869 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-702f9644-bfa5-43bf-bc77-bd7491aac48d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1754 microversion: 2.1 time: 0.165361 Sep 09 23:08:54.235419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 404/796] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:54 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:08:54.901593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:54.902289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:54.908895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:54.909376 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:54.909810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:54.910496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:54.910950 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:54.911374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:55.040211 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:55.049036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:55.050475 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:55.051692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c452856c-b98e-4152-a94a-9f874bb264f6 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1726 microversion: 2.20 time: 0.154377 Sep 09 23:08:55.052241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 393/797] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:54 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:55.077025 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b807de7-5038-4bfb-a64a-af8101d5ee1d"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:55.079458 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:55.086191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:55.086682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:55.087130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:55.087865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:55.088334 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:55.088764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:55.159010 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:08:55.258892 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:55.259659 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:55.266820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:55.267311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:55.267791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:55.268485 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:55.268950 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:55.269418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:55.377149 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d655d37-65fa-4010-b131-d9aadd8a219c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304203 Sep 09 23:08:55.379670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 405/798] 10.222.0.17 () {62 vars in 1364 bytes} [Fri Sep 9 23:08:55 2022] POST /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:08:55.488665 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:55.498119 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1a3214f-8322-4fa8-952a-9061fff42397 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1757 microversion: 2.1 time: 0.243142 Sep 09 23:08:55.498864 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 394/799] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:08:55 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:08:55.537329 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:55.537822 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:55.543786 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:55.544270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:55.544714 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:55.545401 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:55.545853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:55.546273 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:55.959754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cda0ac41-78b5-4d63-9beb-19ce5469de4f tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/os-volume_attachments/9b807de7-5038-4bfb-a64a-af8101d5ee1d" status: 202 len: 0 microversion: 2.20 time: 0.426353 Sep 09 23:08:55.960334 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 406/800] 10.222.0.17 () {60 vars in 1457 bytes} [Fri Sep 9 23:08:55 2022] DELETE /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/os-volume_attachments/9b807de7-5038-4bfb-a64a-af8101d5ee1d => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:08:56.020377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:08:56.020977 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:56.027185 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:56.027707 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:56.028148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:56.028833 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:56.029289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:56.029714 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:56.169004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120603) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 23:08:56.238690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2140246e-bd58-4f61-af8e-ce408c6f4860 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "POST /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/action" status: 202 len: 0 microversion: 2.20 time: 0.222116 Sep 09 23:08:56.239328 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 395/801] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 9 23:08:56 2022] POST /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:08:56.247616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:56.248804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:56.255186 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:56.255777 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:56.256222 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:56.256954 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:56.257415 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:56.258258 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:56.398841 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:56.408108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:56.409586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:56.410740 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-298e5856-1510-4f5a-ad9f-0512304cf2da tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1674 microversion: 2.20 time: 0.167188 Sep 09 23:08:56.411475 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 407/802] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:56 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:57.437412 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:57.438020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:57.444008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:57.444498 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:57.444936 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:57.445624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:57.446076 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:57.446498 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:57.584484 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:57.592960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:57.594500 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:57.595736 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46931f5c-c3bf-495c-9e26-ba30dd60aad2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.163226 Sep 09 23:08:57.596290 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 396/803] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:57 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:58.621810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:58.623651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:58.630023 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:58.630515 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:58.630944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:58.631843 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:58.632462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:58.632882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:58.814257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:58.822830 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:58.824586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:08:58.826548 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63a33589-65f5-4535-b167-09bdfcc7c7bc tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.208393 Sep 09 23:08:58.827126 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 408/804] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:58 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:08:59.855949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:08:59.857777 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:08:59.865794 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:59.866613 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:59.867344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:08:59.868226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:08:59.869099 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:08:59.869689 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:00.033337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:00.043546 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:00.059631 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:00.071804 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb3e338f-821c-4a33-b52c-ec8a9fca28df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.222160 Sep 09 23:09:00.072710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 397/805] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:08:59 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:01.100579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:01.102106 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:01.111543 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:01.113201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:01.113650 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:01.114367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:01.115276 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:01.115743 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:01.583826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:01.593993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:01.595778 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:01.597396 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da74afe2-8028-4cd9-aa43-5fcadeaea6dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.503485 Sep 09 23:09:01.602649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 409/806] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:01 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:02.623954 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:02.624807 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:02.632887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:02.633851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:02.634471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:02.635454 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:02.636080 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:02.636757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:02.799841 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:02.814284 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:02.816258 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:02.818515 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5c64337-cb09-4400-9213-10749b2f5dac tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.199252 Sep 09 23:09:02.819094 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 398/807] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:02 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:03.847160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:03.848745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:03.862668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:03.863382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:03.863849 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:03.864709 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:03.865322 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:03.865909 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:04.002716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:04.011680 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:04.013428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:04.015033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a02d6765-523a-4adf-89e2-f62c977edd98 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.174487 Sep 09 23:09:04.015850 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 410/808] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:03 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:05.040945 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:05.041566 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:05.048395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:05.048876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:05.049311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:05.050001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:05.050455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:05.050881 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:05.200204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:05.209307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:05.211098 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:05.212417 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29fcd0fb-b937-4739-8ac2-24a65c3ec1dd tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.175323 Sep 09 23:09:05.213159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 399/809] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:05 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:06.239541 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:06.240473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:06.250950 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:06.251636 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:06.252282 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:06.253451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:06.254496 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:06.255452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:06.427931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:06.436657 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:06.438076 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:06.439225 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7eeb107b-7fb5-4254-81c0-5e2104b3e587 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.205048 Sep 09 23:09:06.439824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 411/810] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:06 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:07.465447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:07.467531 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:07.476543 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:07.478896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:07.479519 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:07.480580 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:07.481903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:07.482508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:07.657770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:07.666990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:07.670341 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:07.671866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-de957884-89b9-420c-8592-21725f38f646 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.210419 Sep 09 23:09:07.672830 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 400/811] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:07 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:08.698573 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:08.699346 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:08.708108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:08.709123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:08.710267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:08.711004 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:08.711634 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:08.712074 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:08.865608 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:08.874630 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:08.876161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:08.877292 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5c337b3-395c-4d80-bf28-779d603da4f5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.183166 Sep 09 23:09:08.877837 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 412/812] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:08 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:09.901885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:09.902499 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:09.905231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:09.911881 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:09.912440 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:09.913242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:09.913982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:09.914449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:09.914882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:10.054688 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:10.063322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:10.065314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:10.065988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf85ac93-6d25-4815-821e-dc43ed083cd9 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.168020 Sep 09 23:09:10.066550 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 401/813] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:09 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:11.092295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:11.092935 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:11.099181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:11.099692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:11.100124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:11.100808 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:11.101261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:11.101679 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:11.229267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:11.237293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:11.238696 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:11.239873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d96bce9d-b26b-4c02-9be8-fa2e869dfbf1 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.152109 Sep 09 23:09:11.240422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 413/814] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:11 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:11.483999 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-379485189", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:11.537707 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:09:11.809820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:09:11.810241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:09:11.810707 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:09:11.811137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:09:11.811605 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:09:11.820220 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:11.820697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:11.821123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:11.821841 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:11.822288 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:11.822715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:11.839135 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Getting quotas for project c1938d9075c844b1a1839ab2f151e471. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:09:11.843688 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Getting quotas for user b54bb81f4d274eb683f15394e3e5adcd and project c1938d9075c844b1a1839ab2f151e471. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:09:11.854374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:09:11.856629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:09:11.900568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60b73802-eb3d-416b-bd1b-03106173dada tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.420246 Sep 09 23:09:11.901204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 402/815] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:09:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:09:11.912923 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8418a2f-f8f0-460a-9e63-312537cf9fc3 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:11.913537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8418a2f-f8f0-460a-9e63-312537cf9fc3 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:11.967415 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8418a2f-f8f0-460a-9e63-312537cf9fc3 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:11.974400 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8418a2f-f8f0-460a-9e63-312537cf9fc3 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1214 microversion: 2.1 time: 0.065338 Sep 09 23:09:11.975118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 414/816] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:11 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:12.265266 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:12.265896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:12.272624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:12.273111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:12.273543 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:12.274398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:12.274851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:12.275256 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:12.411811 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:12.415466 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:12.421191 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:12.422686 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:12.423862 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91771cf5-1880-4428-89e5-2ed987f668f4 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.163173 Sep 09 23:09:12.424415 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 403/817] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:12 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:12.997444 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:12.998024 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:13.004862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:13.005341 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:13.005777 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:13.006462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:13.006919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:13.007341 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:13.070235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:13.077784 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d059392-223b-4e53-a8f2-75174f42ea64 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1266 microversion: 2.1 time: 0.084326 Sep 09 23:09:13.078346 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 415/818] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:12 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:09:13.449451 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:13.450057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:13.458417 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:13.458900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:13.459337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:13.460063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:13.460519 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:13.460946 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:13.681047 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:13.690547 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:13.692027 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:13.693280 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-173e316f-d0d2-4524-8962-e0d63404a8ed tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.247594 Sep 09 23:09:13.693738 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 404/819] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:13 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:14.080336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-75029884-deb1-41f6-9e7a-11130589aef3 req-648dd0e3-2f1d-4c8b-b091-4293ac7cb373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479d8f15-a236-4cc4-835b-ddbb3ab4569b", "name": "network-vif-plugged", "status": "completed", "tag": "194395d4-13f2-4287-a338-5cc41afb196d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:14.092696 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-75029884-deb1-41f6-9e7a-11130589aef3 req-648dd0e3-2f1d-4c8b-b091-4293ac7cb373 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:14.093673 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-75029884-deb1-41f6-9e7a-11130589aef3 req-648dd0e3-2f1d-4c8b-b091-4293ac7cb373 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:14.095007 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-75029884-deb1-41f6-9e7a-11130589aef3 req-648dd0e3-2f1d-4c8b-b091-4293ac7cb373 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:14.104100 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:14.105047 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:14.113037 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:14.118153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:14.118715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:14.120865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:14.121415 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:14.125578 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:14.128104 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-75029884-deb1-41f6-9e7a-11130589aef3 req-648dd0e3-2f1d-4c8b-b091-4293ac7cb373 service nova] Creating event network-vif-plugged:194395d4-13f2-4287-a338-5cc41afb196d for instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b on hv-cinder-85221 Sep 09 23:09:14.136987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-75029884-deb1-41f6-9e7a-11130589aef3 req-648dd0e3-2f1d-4c8b-b091-4293ac7cb373 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060643 Sep 09 23:09:14.137980 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 416/820] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:09:14.324401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:14.333786 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1dd7e487-2e4e-413e-a59e-cb87d40d29d0 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.233885 Sep 09 23:09:14.334481 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 405/821] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:14 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:09:14.719279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:14.720466 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:14.729144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:14.729960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:14.730751 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:14.732519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:14.733059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:14.733559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:14.866745 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:14.875537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:14.877078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:14.878317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ecbbd8b-e5b1-4d73-8588-83baa4a4bff2 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.163872 Sep 09 23:09:14.878969 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 417/822] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:14 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:15.031680 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7e3c4cfa-190a-45e8-9100-2c0876c5a0cd req-5348dc36-b42f-4c40-93ae-62753586a487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183c9619-a88f-4fa9-82e0-786a3ff55dd8", "tag": "889488c4-ef79-4b82-a71c-ac73ae491dbb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:15.042966 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7e3c4cfa-190a-45e8-9100-2c0876c5a0cd req-5348dc36-b42f-4c40-93ae-62753586a487 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:15.043453 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7e3c4cfa-190a-45e8-9100-2c0876c5a0cd req-5348dc36-b42f-4c40-93ae-62753586a487 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:15.043914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7e3c4cfa-190a-45e8-9100-2c0876c5a0cd req-5348dc36-b42f-4c40-93ae-62753586a487 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:15.054948 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7e3c4cfa-190a-45e8-9100-2c0876c5a0cd req-5348dc36-b42f-4c40-93ae-62753586a487 service nova] Creating event network-changed:889488c4-ef79-4b82-a71c-ac73ae491dbb for instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 on hv-cinder-85221 Sep 09 23:09:15.060403 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7e3c4cfa-190a-45e8-9100-2c0876c5a0cd req-5348dc36-b42f-4c40-93ae-62753586a487 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033503 Sep 09 23:09:15.061000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 406/823] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:15.360661 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:15.361307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:15.368110 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:15.368596 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:15.369032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:15.369733 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:15.370190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:15.370614 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:15.501030 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:15.508704 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f0ec495-08ed-455c-9506-0b8de8b721fa tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.152927 Sep 09 23:09:15.509262 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 418/824] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:15 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:15.905149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:15.905763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:15.911829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:15.912313 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:15.912751 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:15.913436 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:15.913888 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:15.914312 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:16.045362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:16.053302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:16.054979 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:16.056154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c433760f-cab0-4e47-b3e6-1214add5bb48 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.155945 Sep 09 23:09:16.056709 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 407/825] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:15 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:16.531188 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:16.531741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:16.538232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:16.538717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:16.539152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:16.539880 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:16.540338 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:16.540759 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:16.543433 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:16.685927 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:16.694224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df1eb05e-7304-4a7a-ba4c-fe5532aa0fc8 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.166829 Sep 09 23:09:16.707951 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 419/826] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:16 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:17.081455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:17.082067 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:17.088575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:17.089059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:17.089497 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:17.090190 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:17.090646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:17.091115 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:17.218987 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:17.227160 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:17.228639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:17.229793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ad7278a-2f5a-45d1-9fa7-10b9e3c304eb tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1732 microversion: 2.20 time: 0.152262 Sep 09 23:09:17.230350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 408/827] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:17 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:17.717876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:17.718418 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:17.720688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=50 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:17.725949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:17.726463 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:17.726899 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:17.727738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:17.728192 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:17.728614 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:17.856610 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:17.864090 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7f6d3ff-8247-4644-814f-d65c526bd486 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.150730 Sep 09 23:09:17.864652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 420/828] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:17 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:18.255689 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:18.256328 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:18.262687 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:18.263168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:18.263636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:18.264948 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:18.265420 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:18.265846 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:18.397118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:18.405502 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:18.407770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:18.408944 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6fa2050-df93-4702-9010-880b57e4ffdf tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1719 microversion: 2.20 time: 0.157241 Sep 09 23:09:18.409507 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 409/829] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:18 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:18.886526 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:18.887125 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:18.893003 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:18.893486 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:18.893916 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:18.894590 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:18.895040 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:18.895460 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:19.026108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:19.034373 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0c384ca-cd50-4fd2-b58b-9d35f259f052 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.152027 Sep 09 23:09:19.034944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 421/830] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:18 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:20.058161 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:20.058815 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:20.065840 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:20.066319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:20.066755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:20.067435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:20.067909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:20.068327 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:20.203331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:20.211203 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4037e07e-20d9-46bd-a759-f8f068563996 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.157115 Sep 09 23:09:20.211814 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 410/831] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:20 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:21.233978 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:21.234580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:21.241514 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:21.242004 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:21.242434 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:21.243130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:21.243605 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:21.244026 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:21.386912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:21.395395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7232ae5a-9cb8-44ab-98fe-3ed25a0a1546 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.165164 Sep 09 23:09:21.396396 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 422/832] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:21 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:22.142855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c46f4a25-f1f5-4e6b-a40e-64ba1293f8ed req-8e53f467-e094-4ff5-aefb-a3aa862aae60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183c9619-a88f-4fa9-82e0-786a3ff55dd8", "name": "network-vif-plugged", "status": "completed", "tag": "889488c4-ef79-4b82-a71c-ac73ae491dbb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:22.148477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:22.149175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:22.156637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c46f4a25-f1f5-4e6b-a40e-64ba1293f8ed req-8e53f467-e094-4ff5-aefb-a3aa862aae60 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:22.157111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c46f4a25-f1f5-4e6b-a40e-64ba1293f8ed req-8e53f467-e094-4ff5-aefb-a3aa862aae60 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:22.157547 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c46f4a25-f1f5-4e6b-a40e-64ba1293f8ed req-8e53f467-e094-4ff5-aefb-a3aa862aae60 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:22.169166 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c46f4a25-f1f5-4e6b-a40e-64ba1293f8ed req-8e53f467-e094-4ff5-aefb-a3aa862aae60 service nova] Creating event network-vif-plugged:889488c4-ef79-4b82-a71c-ac73ae491dbb for instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 on hv-cinder-85221 Sep 09 23:09:22.174783 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c46f4a25-f1f5-4e6b-a40e-64ba1293f8ed req-8e53f467-e094-4ff5-aefb-a3aa862aae60 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Sep 09 23:09:22.175379 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 411/833] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:22.418042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:22.418683 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:22.420598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:22.426321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:22.426797 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:22.427229 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:22.427942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:22.428396 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:22.428814 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:22.556667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:22.564741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-039eed55-5019-477c-9544-13486c8037ad tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.150517 Sep 09 23:09:22.565306 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 423/834] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:22 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:23.588555 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:23.589239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:23.596721 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:23.597217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:23.597655 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:23.598355 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:23.598808 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:23.599234 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:23.730236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:23.738353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35f5727f-a0fa-48cc-bc28-8451f75a03f7 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1314 microversion: 2.1 time: 0.154050 Sep 09 23:09:23.738907 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 412/835] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:23 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:24.761554 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:24.762175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:24.768777 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:24.769288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:24.769724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:24.770414 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:24.770874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:24.771305 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:24.899698 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:24.907807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-00878107-0f4b-4df8-857c-693ac477dff2 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1464 microversion: 2.1 time: 0.150034 Sep 09 23:09:24.908369 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 424/836] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:24 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:24.953766 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:24.954296 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:24.960632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:24.961116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:24.961602 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:24.962273 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:24.962733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:24.963162 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:24.988781 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:09:25.063427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-326a0031-7ef0-46cc-af61-26b6d0003d77 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "DELETE /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 204 len: 0 microversion: 2.1 time: 0.112939 Sep 09 23:09:25.064182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 413/837] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:09:24 2022] DELETE /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:09:25.072709 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:25.073321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:25.079423 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:25.079942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:25.080399 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:25.081087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:25.081540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:25.081960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:25.211112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:25.220392 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9d68492-bf88-44a1-adbf-7332b9d3506a tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1470 microversion: 2.1 time: 0.151581 Sep 09 23:09:25.220956 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 425/838] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:25 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:09:26.251973 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:26.252675 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:26.259040 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:26.259553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:26.260004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:26.261024 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:26.261150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:26.261571 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:26.403476 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:26.411798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6ed51c8-7861-442e-872f-b9cfa4f1a330 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1470 microversion: 2.1 time: 0.164032 Sep 09 23:09:26.412384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 414/839] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:26 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:27.407372 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-843ad615-b836-40f1-86ab-22c8f5c29e23 req-bbda18ac-4f9f-4ee6-aae7-85a90adec9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183c9619-a88f-4fa9-82e0-786a3ff55dd8", "name": "network-vif-deleted", "tag": "889488c4-ef79-4b82-a71c-ac73ae491dbb"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:27.419520 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-843ad615-b836-40f1-86ab-22c8f5c29e23 req-bbda18ac-4f9f-4ee6-aae7-85a90adec9e5 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:27.420007 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-843ad615-b836-40f1-86ab-22c8f5c29e23 req-bbda18ac-4f9f-4ee6-aae7-85a90adec9e5 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:27.420437 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-843ad615-b836-40f1-86ab-22c8f5c29e23 req-bbda18ac-4f9f-4ee6-aae7-85a90adec9e5 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:27.434030 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-843ad615-b836-40f1-86ab-22c8f5c29e23 req-bbda18ac-4f9f-4ee6-aae7-85a90adec9e5 service nova] Creating event network-vif-deleted:889488c4-ef79-4b82-a71c-ac73ae491dbb for instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 on hv-cinder-85221 Sep 09 23:09:27.434783 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:27.436184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:27.440104 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-843ad615-b836-40f1-86ab-22c8f5c29e23 req-bbda18ac-4f9f-4ee6-aae7-85a90adec9e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037105 Sep 09 23:09:27.441317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 426/840] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:27.447118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:27.447833 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:27.448270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:27.448977 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:27.449597 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:27.450214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:27.524049 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bb81f4d274eb683f15394e3e5adcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1938d9075c844b1a1839ab2f151e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:27.536034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39c4cddb-47a1-4fcb-8fef-fff1ddf13ea1 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 200 len: 1299 microversion: 2.1 time: 0.105315 Sep 09 23:09:27.539548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 415/841] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:27 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:09:28.560655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:28.561505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] [instance: 183c9619-a88f-4fa9-82e0-786a3ff55dd8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:28.570690 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:28.571567 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:28.572360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:28.573318 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:28.573814 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:28.574249 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:28.592066 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] HTTP exception thrown: Instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 could not be found. Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Request method failure captured: Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 HTTP/1.1 Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8eVFGv88ytl5RDqJYWykvoxjeBF3wwp-n5pwiAbgGD-sTdtX2CxN3EaciIYT4_WDv0EIILl3futEl6-1194SN3u16mqBnYqWlJgCyzIu79QNZNFDIPgfotEv03VLx-9cjWnGGcEJC-QOoCN0VyFslnew37baIeoQ_RCr_uWq977KnU Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: c1938d9075c844b1a1839ab2f151e471 Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesNegativeTest-413862913 Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:09:28.594266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c1938d9075c844b1a1839ab2f151e471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c1938d9075c844b1a1839ab2f151e471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c1938d9075c844b1a1839ab2f151e471", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c1938d9075c844b1a1839ab2f151e471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesNegativeTest-413862913 Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: c1938d9075c844b1a1839ab2f151e471 Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesNegativeTest-413862913 Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesNegativeTest-413862913-project Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: b54bb81f4d274eb683f15394e3e5adcd Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesNegativeTest-413862913-project Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 could not be found. Sep 09 23:09:28.595936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '183c9619-a88f-4fa9-82e0-786a3ff55dd8'} Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 could not be found. Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:28.597432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 could not be found. Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 could not be found. Sep 09 23:09:28.599039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:28.600450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] Returning 404 to user: Instance 183c9619-a88f-4fa9-82e0-786a3ff55dd8 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:28.600450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-842249c2-1b43-424e-a293-2edd810d6540 tempest-VolumesNegativeTest-413862913 tempest-VolumesNegativeTest-413862913-project] 10.222.0.17 "GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8" status: 404 len: 111 microversion: 2.1 time: 0.039997 Sep 09 23:09:28.600450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 427/842] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:28 2022] GET /compute/v2.1/servers/183c9619-a88f-4fa9-82e0-786a3ff55dd8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:09:34.197611 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:34.198133 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:34.204220 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:34.204701 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:34.205137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:34.205825 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:34.206280 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:34.206704 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:34.230930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c47a54df-95e7-4fe7-aed9-db51696ec953 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037266 Sep 09 23:09:34.231479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 416/843] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:09:34 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:35.562308 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02263204-b442-4df7-9137-6b2b6b8a9ce8"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:35.564649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:35.571127 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:35.571643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:35.572165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:35.572861 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:35.573361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:35.573732 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:35.838284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f185269e-6164-41e3-8904-7b1cb8c0363f tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "POST /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280102 Sep 09 23:09:35.838834 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 428/844] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:09:35 2022] POST /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:36.884172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-821642302"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:36.884709 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:36.891594 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:36.892084 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:36.892526 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:36.893214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:36.893673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:36.894100 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:37.022661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Removing security group 2be04b67-c3e8-47ee-b069-1eb2dcc7331b from port 279bf0ab-3755-42fc-a26c-13b4e5a027af Sep 09 23:09:37.339317 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4661dd0a-0bc3-4b76-a740-015f07e7fa1d tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "POST /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/action" status: 202 len: 0 microversion: 2.1 time: 0.459029 Sep 09 23:09:37.339988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 417/845] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:09:36 2022] POST /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:09:37.350260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-af756092-0e2c-441a-9143-42e6c45f02de req-132e4235-b79c-4f80-9fae-f5325ba54eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b843e4fc-3be4-452c-a494-ac0093397048", "tag": "279bf0ab-3755-42fc-a26c-13b4e5a027af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:37.361231 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af756092-0e2c-441a-9143-42e6c45f02de req-132e4235-b79c-4f80-9fae-f5325ba54eb6 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:37.361713 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af756092-0e2c-441a-9143-42e6c45f02de req-132e4235-b79c-4f80-9fae-f5325ba54eb6 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:37.362143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af756092-0e2c-441a-9143-42e6c45f02de req-132e4235-b79c-4f80-9fae-f5325ba54eb6 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:37.373489 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-af756092-0e2c-441a-9143-42e6c45f02de req-132e4235-b79c-4f80-9fae-f5325ba54eb6 service nova] Creating event network-changed:279bf0ab-3755-42fc-a26c-13b4e5a027af for instance b843e4fc-3be4-452c-a494-ac0093397048 on hv-cinder-85221 Sep 09 23:09:37.378992 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-af756092-0e2c-441a-9143-42e6c45f02de req-132e4235-b79c-4f80-9fae-f5325ba54eb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032745 Sep 09 23:09:37.379906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 429/846] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:09:38.433658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b5cfde92-c8e9-4bc7-a121-a6d05651203a req-3248146c-2bd7-4fd7-ba27-8c524c5817f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b843e4fc-3be4-452c-a494-ac0093397048", "tag": "279bf0ab-3755-42fc-a26c-13b4e5a027af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:38.437780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:38.438278 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:38.444277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:38.444769 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:38.445209 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:38.445908 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:38.446565 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:38.446994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:38.448796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b5cfde92-c8e9-4bc7-a121-a6d05651203a req-3248146c-2bd7-4fd7-ba27-8c524c5817f4 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:38.449347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b5cfde92-c8e9-4bc7-a121-a6d05651203a req-3248146c-2bd7-4fd7-ba27-8c524c5817f4 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:38.449953 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b5cfde92-c8e9-4bc7-a121-a6d05651203a req-3248146c-2bd7-4fd7-ba27-8c524c5817f4 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:38.460878 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b5cfde92-c8e9-4bc7-a121-a6d05651203a req-3248146c-2bd7-4fd7-ba27-8c524c5817f4 service nova] Creating event network-changed:279bf0ab-3755-42fc-a26c-13b4e5a027af for instance b843e4fc-3be4-452c-a494-ac0093397048 on hv-cinder-85221 Sep 09 23:09:38.466148 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b5cfde92-c8e9-4bc7-a121-a6d05651203a req-3248146c-2bd7-4fd7-ba27-8c524c5817f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037139 Sep 09 23:09:38.466801 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 430/847] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:38.534409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lazy-loading 'services' on Instance uuid b843e4fc-3be4-452c-a494-ac0093397048 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:09:38.616733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab257246-25e4-4762-8699-208df8ca276c tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments/062b399d-c0a6-44df-ab6b-aba33e605594" status: 202 len: 0 microversion: 2.1 time: 0.191638 Sep 09 23:09:38.617493 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 418/848] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:09:38 2022] DELETE /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments/062b399d-c0a6-44df-ab6b-aba33e605594 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:09:38.626853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:38.629290 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:38.642390 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:38.642951 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:38.643508 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:38.644348 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:38.645031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:38.645542 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:38.678773 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b146a180-ef9a-4c9e-af9d-f9d73ed128c3 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056250 Sep 09 23:09:38.679930 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 431/849] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:09:38 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:39.694007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:39.696383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:39.702501 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:39.702988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:39.703430 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:39.704164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:39.704629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:39.705059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:39.738581 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00df7470-c2a6-4de5-8d07-5b5515b23b09 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049293 Sep 09 23:09:39.739315 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 419/850] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:09:39 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:40.750944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:40.753202 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:40.759519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:40.760000 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:40.760426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:40.761111 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:40.761558 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:40.761975 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:40.790177 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-997baa1b-b584-4b76-b556-5cf3feb0f281 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Sep 09 23:09:40.790720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 432/851] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:09:40 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:41.803111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:41.805518 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:41.807900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:41.813682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:41.814154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:41.814582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:41.815262 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:41.815741 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:41.816162 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:41.820661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:41.846509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bda009fd-1436-448d-a61a-418ffbae07db tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047387 Sep 09 23:09:41.847059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 420/852] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:09:41 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:42.858321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:42.860536 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:42.866881 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:42.867361 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:42.867840 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:42.868529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:42.868981 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:42.869400 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:42.899139 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31bc7edc-13b0-4613-b7fd-77a81db09545 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 09 23:09:42.899736 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 433/853] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:09:42 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:43.495456 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:43.495962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:43.502944 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:43.503427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:43.503896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:43.504590 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:43.505043 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:43.505469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:43.584470 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lazy-loading 'services' on Instance uuid 7b7be666-57e9-4a77-babb-e86eebc9856b {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:09:43.655103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2bf71c3c-f6e6-4933-877b-8b0de8b25bac tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-volume_attachments/02263204-b442-4df7-9137-6b2b6b8a9ce8" status: 202 len: 0 microversion: 2.1 time: 0.163430 Sep 09 23:09:43.655754 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 421/854] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:09:43 2022] DELETE /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-volume_attachments/02263204-b442-4df7-9137-6b2b6b8a9ce8 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:09:43.664381 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:43.666608 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:43.673039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:43.673472 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:43.673903 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:43.674594 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:43.675224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:43.675832 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:43.708123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6760b8b-293d-466f-ac72-ca10d6e283d8 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047894 Sep 09 23:09:43.708735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 434/855] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:09:43 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:43.913354 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:43.915616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:43.922242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:43.922721 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:43.923148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:43.923854 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:43.924303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:43.924748 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:43.952571 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce6a74ab-173a-4110-a08c-1fe6b860a03e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043616 Sep 09 23:09:43.953107 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 422/856] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:09:43 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:09:43.963773 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:43.964299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:43.970730 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:43.971243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:43.971707 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:43.972392 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:43.972842 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:43.973262 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:44.053006 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] HTTP exception thrown: Instance b843e4fc-3be4-452c-a494-ac0093397048 is not attached to volume 062b399d-c0a6-44df-ab6b-aba33e605594 Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Request method failure captured: Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments/062b399d-c0a6-44df-ab6b-aba33e605594 HTTP/1.1 Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8cZqao-pMfYfO13AUV0fTsU5kXTJ3AuaDixJAsEo0YhiRyQw1vBTt8EWUQZJYndTDh-iuGaVytygUSL9kqVdnDAZjA8PgPKXgpIzc12Lh_n6gpKDVJDpEx8KXYbMMbUrZUxAgk0edsMpdCCPHbVhkzklUj1ePkjPmgPWjOZLsiT9b4 Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 52565b3ddbe9435e8112f134f6c5d496 Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestMinimumBasicScenario-393862006 Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:09:44.055701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52565b3ddbe9435e8112f134f6c5d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52565b3ddbe9435e8112f134f6c5d496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52565b3ddbe9435e8112f134f6c5d496", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52565b3ddbe9435e8112f134f6c5d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestMinimumBasicScenario-393862006 Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 52565b3ddbe9435e8112f134f6c5d496 Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestMinimumBasicScenario-393862006 Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-TestMinimumBasicScenario-393862006-project Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 1bdf9e74be004e8ab24b9a15bb8904d2 Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestMinimumBasicScenario-393862006-project Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:09:44.057321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance b843e4fc-3be4-452c-a494-ac0093397048 is not attached to volume 062b399d-c0a6-44df-ab6b-aba33e605594 Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'server_id': 'b843e4fc-3be4-452c-a494-ac0093397048', 'id': '062b399d-c0a6-44df-ab6b-aba33e605594'} Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 062b399d-c0a6-44df-ab6b-aba33e605594. Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:44.058257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b843e4fc-3be4-452c-a494-ac0093397048 is not attached to volume 062b399d-c0a6-44df-ab6b-aba33e605594 Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b843e4fc-3be4-452c-a494-ac0093397048 is not attached to volume 062b399d-c0a6-44df-ab6b-aba33e605594 Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:44.059874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Returning 404 to user: Instance b843e4fc-3be4-452c-a494-ac0093397048 is not attached to volume 062b399d-c0a6-44df-ab6b-aba33e605594 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:44.061101 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae56877d-62ba-4563-bdf8-43e730c18fe5 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments/062b399d-c0a6-44df-ab6b-aba33e605594" status: 404 len: 154 microversion: 2.1 time: 0.097403 Sep 09 23:09:44.061101 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 435/857] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:09:43 2022] DELETE /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048/os-volume_attachments/062b399d-c0a6-44df-ab6b-aba33e605594 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:44.721320 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:44.723384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:44.730343 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:44.730824 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:44.731259 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:44.732004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:44.732523 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:44.732864 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:44.761730 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ea82442-7a58-4158-ab07-7e711c5f133b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044878 Sep 09 23:09:44.762214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 423/858] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:09:44 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:09:44.824135 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:44.824638 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:44.830583 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:44.831066 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:44.831527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:44.832227 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:44.832688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:44.833118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:44.858239 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:09:44.872477 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:44.939287 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef6e5fe0-490a-459e-825d-c8c7a15f4fdd tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 204 len: 0 microversion: 2.1 time: 0.118763 Sep 09 23:09:44.939892 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 436/859] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:09:44 2022] DELETE /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:09:44.947860 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:44.948470 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:44.955093 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:44.955620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:44.956050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:44.956741 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:44.957197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:44.957645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:45.088279 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:45.096177 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d8b2955-98d7-44bc-8eca-6146e1c9b69b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1683 microversion: 2.1 time: 0.152121 Sep 09 23:09:45.096740 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 424/860] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:44 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:45.199660 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:45.200256 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:45.206490 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:45.206973 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:45.207416 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:45.208137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:45.208602 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:45.209031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:45.235391 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:09:45.307747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5bc8e3e7-9e6b-478f-b3f1-cd204ea33422 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 204 len: 0 microversion: 2.1 time: 0.111983 Sep 09 23:09:45.308254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 437/861] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:09:45 2022] DELETE /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:09:45.317178 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:45.317789 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:45.323618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:45.324100 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:45.324530 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:45.325213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:45.325663 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:45.326088 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:45.457871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:45.465469 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b7d96b71-763c-4106-882c-ccd3e48b0b69 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1553 microversion: 2.1 time: 0.152829 Sep 09 23:09:45.466025 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 425/862] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:45 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:46.120250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:46.120994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:46.127590 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:46.128079 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:46.128518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:46.129201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:46.129658 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:46.130084 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:46.258507 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:46.266431 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bd83576-4fc9-454e-996b-fc6d9eb2dc95 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1683 microversion: 2.1 time: 0.150536 Sep 09 23:09:46.267204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 438/863] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:46 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:46.489616 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:46.490149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:46.496417 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:46.496894 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:46.497323 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:46.497999 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:46.498447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:46.498866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:46.626022 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:46.633697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e60270b6-daaa-45e1-937f-2ab02ce05865 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1553 microversion: 2.1 time: 0.148088 Sep 09 23:09:46.634261 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 426/864] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:46 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:47.290646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:47.291255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:47.298466 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:47.298944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:47.299379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:47.300093 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:47.300549 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:47.300973 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:47.429994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:47.437863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d2bf863c-d770-4c33-8138-b7b306566488 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1683 microversion: 2.1 time: 0.151071 Sep 09 23:09:47.438430 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 439/865] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:47 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:47.657461 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:47.658072 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:47.664416 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:47.664893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:47.665329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:47.666018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:47.666490 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:47.666898 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:47.797032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:47.804935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4169a201-aa3e-4133-a32a-38636c59486e tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1553 microversion: 2.1 time: 0.151955 Sep 09 23:09:47.805492 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 427/866] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:47 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:48.461549 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:48.462299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:48.464724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:09:48.470187 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:48.470671 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:48.471101 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:48.472038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:48.472488 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:48.472910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:48.603438 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:48.611892 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47f356ac-c6e4-44e5-b0e4-c4e00ce4e351 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1683 microversion: 2.1 time: 0.154218 Sep 09 23:09:48.612558 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 440/867] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:48 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:48.828806 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:48.829407 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:48.835700 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:48.836187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:48.836625 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:48.837321 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:48.837777 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:48.838206 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:49.149631 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdf9e74be004e8ab24b9a15bb8904d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52565b3ddbe9435e8112f134f6c5d496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:49.157960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3b8cf84-4ce2-4610-8120-d45c32af1d5a tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 200 len: 1553 microversion: 2.1 time: 0.333439 Sep 09 23:09:49.158530 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 428/868] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:48 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 1553 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:49.377837 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-08e9b471-5ed2-423e-a606-ec518e361acd req-f4c9e5b7-a43d-443f-a52f-f61149858f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b843e4fc-3be4-452c-a494-ac0093397048", "name": "network-vif-deleted", "tag": "279bf0ab-3755-42fc-a26c-13b4e5a027af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:49.388819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-08e9b471-5ed2-423e-a606-ec518e361acd req-f4c9e5b7-a43d-443f-a52f-f61149858f71 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:49.389846 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-08e9b471-5ed2-423e-a606-ec518e361acd req-f4c9e5b7-a43d-443f-a52f-f61149858f71 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:49.390637 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-08e9b471-5ed2-423e-a606-ec518e361acd req-f4c9e5b7-a43d-443f-a52f-f61149858f71 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:49.406643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-08e9b471-5ed2-423e-a606-ec518e361acd req-f4c9e5b7-a43d-443f-a52f-f61149858f71 service nova] Creating event network-vif-deleted:279bf0ab-3755-42fc-a26c-13b4e5a027af for instance b843e4fc-3be4-452c-a494-ac0093397048 on hv-cinder-85221 Sep 09 23:09:49.414912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-08e9b471-5ed2-423e-a606-ec518e361acd req-f4c9e5b7-a43d-443f-a52f-f61149858f71 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040873 Sep 09 23:09:49.416190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 441/869] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:49.635179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:49.640096 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:49.648326 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:49.649178 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:49.651336 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:49.652486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:49.653887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:49.655113 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:49.744344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cd8a90230b4c69886534be67acd943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba38c443abf49a48bdb55f42dac68b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:49.754214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-732d53e9-4365-41d1-be37-bc4bf8d4123d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 200 len: 1615 microversion: 2.1 time: 0.122799 Sep 09 23:09:49.755832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 429/870] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:49 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 1615 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:50.184450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:50.186182 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] [instance: b843e4fc-3be4-452c-a494-ac0093397048] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:50.194450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:50.195050 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:50.195648 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:50.196447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:50.197146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:50.197673 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:50.211692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] HTTP exception thrown: Instance b843e4fc-3be4-452c-a494-ac0093397048 could not be found. Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Request method failure captured: Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 HTTP/1.1 Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8cZqao-pMfYfO13AUV0fTsU5kXTJ3AuaDixJAsEo0YhiRyQw1vBTt8EWUQZJYndTDh-iuGaVytygUSL9kqVdnDAZjA8PgPKXgpIzc12Lh_n6gpKDVJDpEx8KXYbMMbUrZUxAgk0edsMpdCCPHbVhkzklUj1ePkjPmgPWjOZLsiT9b4 Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 52565b3ddbe9435e8112f134f6c5d496 Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestMinimumBasicScenario-393862006 Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:09:50.213362 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52565b3ddbe9435e8112f134f6c5d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52565b3ddbe9435e8112f134f6c5d496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52565b3ddbe9435e8112f134f6c5d496", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52565b3ddbe9435e8112f134f6c5d496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestMinimumBasicScenario-393862006 Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 52565b3ddbe9435e8112f134f6c5d496 Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestMinimumBasicScenario-393862006 Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-TestMinimumBasicScenario-393862006-project Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 1bdf9e74be004e8ab24b9a15bb8904d2 Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestMinimumBasicScenario-393862006-project Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance b843e4fc-3be4-452c-a494-ac0093397048 could not be found. Sep 09 23:09:50.215056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'b843e4fc-3be4-452c-a494-ac0093397048'} Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b843e4fc-3be4-452c-a494-ac0093397048 could not be found. Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:50.216060 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b843e4fc-3be4-452c-a494-ac0093397048 could not be found. Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b843e4fc-3be4-452c-a494-ac0093397048 could not be found. Sep 09 23:09:50.217625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.219597 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Returning 404 to user: Instance b843e4fc-3be4-452c-a494-ac0093397048 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:50.219597 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3f3fc37c-f36c-4e9c-a007-493600b8f488 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048" status: 404 len: 111 microversion: 2.1 time: 0.036854 Sep 09 23:09:50.219597 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 442/871] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:50 2022] GET /compute/v2.1/servers/b843e4fc-3be4-452c-a494-ac0093397048 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:50.228342 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ead53914-43f9-489a-a540-19ab9ebab089 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] Calling method '.version_select at 0x7fcecf33b790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:50.249060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ead53914-43f9-489a-a540-19ab9ebab089 tempest-TestMinimumBasicScenario-393862006 tempest-TestMinimumBasicScenario-393862006-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1245104049" status: 202 len: 0 microversion: 2.1 time: 0.024480 Sep 09 23:09:50.249703 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 430/872] 10.222.0.17 () {58 vars in 1272 bytes} [Fri Sep 9 23:09:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1245104049 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:09:50.779418 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:50.780297 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:50.787008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:50.787767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:50.788245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:50.788947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:50.789481 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:50.789972 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:50.804304 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b HTTP/1.1 Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:09:50.805882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:50.807332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '7b7be666-57e9-4a77-babb-e86eebc9856b'} Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:50.808445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:50.809684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:50.810871 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:50.810871 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d767aea9-2415-45c1-8955-996d791ec95b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 404 len: 111 microversion: 2.1 time: 0.032062 Sep 09 23:09:50.812962 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 443/873] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:50 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:50.817809 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53bd42d2-4750-4b7b-9636-33fadccad34d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '.version_select at 0x7fced2ca1670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:50.841366 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53bd42d2-4750-4b7b-9636-33fadccad34d tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452235589" status: 202 len: 0 microversion: 2.1 time: 0.027313 Sep 09 23:09:50.842730 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 431/874] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 9 23:09:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452235589 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:09:51.558371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-50debb25-19c3-47be-940a-f01c3dcac538 req-49ef4c76-a2b7-4fa7-9b6d-12eb8790dd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7be666-57e9-4a77-babb-e86eebc9856b", "name": "network-vif-deleted", "tag": "ac3a34e4-9d78-4dcb-bf8b-165c55063398"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:51.575966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-50debb25-19c3-47be-940a-f01c3dcac538 req-49ef4c76-a2b7-4fa7-9b6d-12eb8790dd16 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:51.576551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-50debb25-19c3-47be-940a-f01c3dcac538 req-49ef4c76-a2b7-4fa7-9b6d-12eb8790dd16 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:51.577040 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-50debb25-19c3-47be-940a-f01c3dcac538 req-49ef4c76-a2b7-4fa7-9b6d-12eb8790dd16 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:51.590427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-50debb25-19c3-47be-940a-f01c3dcac538 req-49ef4c76-a2b7-4fa7-9b6d-12eb8790dd16 service nova] Creating event network-vif-deleted:ac3a34e4-9d78-4dcb-bf8b-165c55063398 for instance 7b7be666-57e9-4a77-babb-e86eebc9856b on hv-cinder-85221 Sep 09 23:09:51.595618 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-50debb25-19c3-47be-940a-f01c3dcac538 req-49ef4c76-a2b7-4fa7-9b6d-12eb8790dd16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042957 Sep 09 23:09:51.596223 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 444/875] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:09:52.608717 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:52.609843 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:52.616537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:52.617085 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:52.617620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:52.618573 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:52.619130 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:52.619681 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:52.636637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b HTTP/1.1 Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:09:52.638577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.640311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '7b7be666-57e9-4a77-babb-e86eebc9856b'} Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:52.641307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.642836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.644355 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:52.644865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08d51088-b04d-48a6-bc8e-a593f26e801b tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 404 len: 111 microversion: 2.1 time: 0.040619 Sep 09 23:09:52.645879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 432/876] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:09:52 2022] DELETE /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:52.655394 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:52.656975 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 7b7be666-57e9-4a77-babb-e86eebc9856b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:52.665187 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:52.666124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:52.666926 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:52.667705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:52.668174 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:52.668865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:52.684606 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b HTTP/1.1 Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:09:52.686345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.688667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '7b7be666-57e9-4a77-babb-e86eebc9856b'} Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:52.691971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. Sep 09 23:09:52.693221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:52.694314 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance 7b7be666-57e9-4a77-babb-e86eebc9856b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:52.694314 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6998d25c-4e06-45ed-bd01-93f3ce5551ab tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b" status: 404 len: 111 microversion: 2.1 time: 0.038513 Sep 09 23:09:52.694314 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 445/877] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:52 2022] GET /compute/v2.1/servers/7b7be666-57e9-4a77-babb-e86eebc9856b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:53.844260 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:53.844948 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:53.851272 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:53.851949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:53.852391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:53.853084 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:53.853542 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:53.853968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:53.867404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f HTTP/1.1 Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:09:53.868991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.870551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'a46f9130-09a3-430e-b22a-abc9830ed20f'} Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:53.871468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.872965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.874380 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:53.874380 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4c62f09-3dee-4a50-9234-6c742765d48a tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 404 len: 111 microversion: 2.1 time: 0.030044 Sep 09 23:09:53.874380 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 433/878] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:09:53 2022] DELETE /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:53.879479 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:53.880065 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: a46f9130-09a3-430e-b22a-abc9830ed20f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:53.886080 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:53.886554 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:53.886983 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:53.887694 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:53.888148 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:53.888596 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:53.902586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f HTTP/1.1 Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:09:53.904317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.906351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'a46f9130-09a3-430e-b22a-abc9830ed20f'} Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:53.907379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. Sep 09 23:09:53.908887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.910236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance a46f9130-09a3-430e-b22a-abc9830ed20f could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:53.910236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5f62d4f-46ed-4b1f-bd5c-e0eff87a20be tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f" status: 404 len: 111 microversion: 2.1 time: 0.030719 Sep 09 23:09:53.910236 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 446/879] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:53 2022] GET /compute/v2.1/servers/a46f9130-09a3-430e-b22a-abc9830ed20f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:53.914268 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:53.914764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:53.920854 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:53.921509 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:53.930012 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:53.930799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:53.931389 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:53.931856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:53.956816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f HTTP/1.1 Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:09:53.959041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:53.960669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'd62121a3-5749-4ac2-887a-4eb11c33363f'} Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:53.961568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:53.962890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:53.964226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:53.964226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39256831-989b-45dc-860b-f6982c6da475 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 404 len: 111 microversion: 2.1 time: 0.050237 Sep 09 23:09:53.964226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 434/880] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:09:53 2022] DELETE /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:09:53.970465 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:53.971087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: d62121a3-5749-4ac2-887a-4eb11c33363f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:53.985076 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:53.985568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:53.986002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:53.986705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:53.987153 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:53.987764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:54.007261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f HTTP/1.1 Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:09:54.008873 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:54.010492 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'd62121a3-5749-4ac2-887a-4eb11c33363f'} Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:54.011406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. Sep 09 23:09:54.013655 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:54.014938 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance d62121a3-5749-4ac2-887a-4eb11c33363f could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:54.014938 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3eb52397-443e-453c-9ff1-7a6fb2da5bb9 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f" status: 404 len: 111 microversion: 2.1 time: 0.044827 Sep 09 23:09:54.014938 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 447/881] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:53 2022] GET /compute/v2.1/servers/d62121a3-5749-4ac2-887a-4eb11c33363f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:55.162545 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:55.163100 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:55.169582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:55.170348 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:55.170639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:55.171332 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:55.171939 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:55.172638 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:55.187051 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 HTTP/1.1 Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:09:55.189281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.190935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '04df6bca-4a68-4c7c-a314-ab08a28dfec3'} Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:55.191934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.193233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.194657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:55.194657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66029515-1fb1-406a-9f37-acfb4df38ae2 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "DELETE /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 404 len: 111 microversion: 2.1 time: 0.032038 Sep 09 23:09:55.194657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 435/882] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:09:55 2022] DELETE /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:55.199834 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:55.200464 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] [instance: 04df6bca-4a68-4c7c-a314-ab08a28dfec3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:55.207422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:55.208019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:55.208522 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:55.209284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:55.209809 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:55.210321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:55.223518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] HTTP exception thrown: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Request method failure captured: Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 HTTP/1.1 Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YN7ujtBUVrng9XJdl8w84Ji5wvmRlj8EvO5nkNvS8Q2idzELcKGCx2jruA8U-s85yulMwTBniXT5V91gGw3DPwdXaYnuEmlFz3bk6bU_Sfx1WDniIn613szjNNxGsXzXEmcnjVcYXp4NtqVbzh5yWrSfc68tH6IssscmAF63Egqeg Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:09:55.225151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cba38c443abf49a48bdb55f42dac68b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cba38c443abf49a48bdb55f42dac68b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: cba38c443abf49a48bdb55f42dac68b0 Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511356730 Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 85cd8a90230b4c69886534be67acd943 Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-511356730-project Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.227208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '04df6bca-4a68-4c7c-a314-ab08a28dfec3'} Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:09:55.228405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. Sep 09 23:09:55.229858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:09:55.231724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] Returning 404 to user: Instance 04df6bca-4a68-4c7c-a314-ab08a28dfec3 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:09:55.231724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c822d738-34e9-4314-ad73-649e477dcf52 tempest-AttachVolumeNegativeTest-511356730 tempest-AttachVolumeNegativeTest-511356730-project] 10.222.0.17 "GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3" status: 404 len: 111 microversion: 2.1 time: 0.030846 Sep 09 23:09:55.231724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 448/883] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:09:55 2022] GET /compute/v2.1/servers/04df6bca-4a68-4c7c-a314-ab08a28dfec3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:09:56.666159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:56.669203 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:56.676545 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:56.678232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:56.678905 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:56.680148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:56.681287 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:56.681940 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:56.720226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7af467ad-36f8-4d8d-8fd3-18d3c80c5cd7 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058022 Sep 09 23:09:56.726982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 436/884] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 23:09:56 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:09:56.808512 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:56.810583 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:56.818324 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:56.819078 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:56.819588 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:56.820426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:56.820882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:56.821535 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:56.850762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:09:56.969196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3d56dfd9-f799-4d32-a7e5-409ea8430c27 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 204 len: 0 microversion: 2.20 time: 0.166438 Sep 09 23:09:56.970027 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 449/885] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 9 23:09:56 2022] DELETE /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 23:09:56.978228 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:56.979142 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:56.987171 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:56.987884 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:56.988694 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:56.989496 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:56.990121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:56.990713 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:57.239636 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:57.252176 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:57.253624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:57.255313 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6d58e46-89f0-4580-a29b-6ba34dd1cf89 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.280723 Sep 09 23:09:57.260853 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 437/886] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:56 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:58.283410 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:58.284251 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:58.291243 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:58.291760 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:58.292199 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:58.292895 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:58.293366 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:58.293908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:58.492206 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:58.504058 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:58.512769 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:58.515062 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4f02a27-4644-40f6-97d8-e79f5e89dc59 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1725 microversion: 2.20 time: 0.235804 Sep 09 23:09:58.517419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 450/887] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:58 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:59.545145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:09:59.545772 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:09:59.557492 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:59.558010 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:59.558455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:59.560385 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:59.560708 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:59.561184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:59.670695 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:59.700245 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:59.702487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaef8f72768e4d1daf21257fdaf580d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8084c097adde47ffadcacca8f4d3ea73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:09:59.703788 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f48f53ad-7749-4cb0-80d4-8cf10f6f67df tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 200 len: 1657 microversion: 2.20 time: 0.165487 Sep 09 23:09:59.704376 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 438/888] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:09:59 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 1657 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:09:59.800341 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1d193ba0-f454-457e-97a9-696e17eea1b9 req-72387fa2-5d68-48c0-9d0d-f35a66067e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479d8f15-a236-4cc4-835b-ddbb3ab4569b", "name": "network-vif-deleted", "tag": "194395d4-13f2-4287-a338-5cc41afb196d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:09:59.824818 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1d193ba0-f454-457e-97a9-696e17eea1b9 req-72387fa2-5d68-48c0-9d0d-f35a66067e25 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:09:59.825761 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1d193ba0-f454-457e-97a9-696e17eea1b9 req-72387fa2-5d68-48c0-9d0d-f35a66067e25 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:09:59.826439 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1d193ba0-f454-457e-97a9-696e17eea1b9 req-72387fa2-5d68-48c0-9d0d-f35a66067e25 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:09:59.845946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1d193ba0-f454-457e-97a9-696e17eea1b9 req-72387fa2-5d68-48c0-9d0d-f35a66067e25 service nova] Creating event network-vif-deleted:194395d4-13f2-4287-a338-5cc41afb196d for instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b on hv-cinder-85221 Sep 09 23:09:59.852853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1d193ba0-f454-457e-97a9-696e17eea1b9 req-72387fa2-5d68-48c0-9d0d-f35a66067e25 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056263 Sep 09 23:09:59.861656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 451/889] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:00.736746 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:00.738064 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:00.748965 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:00.750575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:00.751285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:00.753025 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:00.753738 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:00.754360 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:00.774419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] HTTP exception thrown: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Request method failure captured: Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b HTTP/1.1 Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YM1Rph_Rjp-vagUJ1uQht2flZH2y96gSMQaiHJDvuz2h8rZ8KtOJjq0J_HCIVFBiJ7_nCG9IrkT6aaC3wske5Izzf2NnVshd6OGZenS3QKE4bX1270JaslCckt9JBBtMJ-OKKG5jvPsQtHX6b6lKEzbCqh1L-jH9GXE_uqghudZes Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:10:00.777181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8084c097adde47ffadcacca8f4d3ea73", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: eaef8f72768e4d1daf21257fdaf580d2 Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:00.778645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '479d8f15-a236-4cc4-835b-ddbb3ab4569b'} Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:10:00.779661 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:00.781673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:00.784540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Returning 404 to user: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:10:00.789626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff9e6e39-f4d2-4664-b9b2-1d668f5e5410 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 404 len: 111 microversion: 2.20 time: 0.061476 Sep 09 23:10:00.790762 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 439/890] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:10:00 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:10:00.805174 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac0a6d1d-ffa4-47bc-bd27-6fc81c5e969d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '.version_select at 0x7fcecf2d79d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:00.881620 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac0a6d1d-ffa4-47bc-bd27-6fc81c5e969d tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-759644213" status: 204 len: 0 microversion: 2.20 time: 0.085440 Sep 09 23:10:00.882221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 452/891] 10.222.0.17 () {60 vars in 1259 bytes} [Fri Sep 9 23:10:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-759644213 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 23:10:01.113649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd157968-3260-440e-be1e-efff7642af8e tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Action: 'create', calling method: .version_select at 0x7fcecf27ca60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-285628731", "metadata": {"Type": "work"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:01.671992 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd157968-3260-440e-be1e-efff7642af8e tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.779951 Sep 09 23:10:01.672739 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 440/892] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 9 23:10:00 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 782 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 23:10:01.687299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f58725b0-e630-4d85-a21c-63c891478cb0 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Calling method '.version_select at 0x7fcecf324820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:01.767991 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f58725b0-e630-4d85-a21c-63c891478cb0 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa" status: 200 len: 352 microversion: 2.1 time: 0.084896 Sep 09 23:10:01.769147 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 453/893] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:10:01 2022] GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:02.784544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ff38571-f57b-4343-b3b8-f13f87e606b1 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Calling method '.version_select at 0x7fced2ca1670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:02.842610 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ff38571-f57b-4343-b3b8-f13f87e606b1 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa" status: 200 len: 353 microversion: 2.1 time: 0.063051 Sep 09 23:10:02.844554 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 441/894] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:10:02 2022] GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:02.858433 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abbd1c91-3148-4457-940c-3e96f71c9dc9 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Calling method '.version_select at 0x7fcecf3b2040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:02.919809 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-abbd1c91-3148-4457-940c-3e96f71c9dc9 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa" status: 200 len: 353 microversion: 2.1 time: 0.066355 Sep 09 23:10:02.920753 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 454/895] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:10:02 2022] GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:02.939362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fad08c8-b84d-45ee-838d-0911ae4bf0d1 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Calling method '.version_select at 0x7fcecf27c940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:02.981437 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:02.982195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:02.989646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:02.990271 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:02.990807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:02.991674 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:02.992261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:02.992789 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:03.014618 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] HTTP exception thrown: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Request method failure captured: Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b HTTP/1.1 Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YM1Rph_Rjp-vagUJ1uQht2flZH2y96gSMQaiHJDvuz2h8rZ8KtOJjq0J_HCIVFBiJ7_nCG9IrkT6aaC3wske5Izzf2NnVshd6OGZenS3QKE4bX1270JaslCckt9JBBtMJ-OKKG5jvPsQtHX6b6lKEzbCqh1L-jH9GXE_uqghudZes Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:10:03.018280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8084c097adde47ffadcacca8f4d3ea73", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: eaef8f72768e4d1daf21257fdaf580d2 Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.020087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '479d8f15-a236-4cc4-835b-ddbb3ab4569b'} Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:10:03.020989 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.022443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.023990 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Returning 404 to user: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:10:03.026918 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1179488-f729-4173-9cfb-a884f78eb782 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 404 len: 111 microversion: 2.20 time: 0.049504 Sep 09 23:10:03.028591 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 455/896] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 9 23:10:02 2022] DELETE /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 23:10:03.037888 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:03.038817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 479d8f15-a236-4cc4-835b-ddbb3ab4569b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:03.045132 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fad08c8-b84d-45ee-838d-0911ae4bf0d1 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa" status: 202 len: 0 microversion: 2.1 time: 0.109560 Sep 09 23:10:03.045756 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 442/897] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:10:02 2022] DELETE /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:10:03.054806 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8b270b1-c441-41cf-9455-de85562eb4e2 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Calling method '.version_select at 0x7fcecf27c310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:03.064457 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:03.065075 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:03.065389 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:03.066158 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:03.066731 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:03.067081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:03.103389 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] HTTP exception thrown: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Request method failure captured: Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b HTTP/1.1 Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YM1Rph_Rjp-vagUJ1uQht2flZH2y96gSMQaiHJDvuz2h8rZ8KtOJjq0J_HCIVFBiJ7_nCG9IrkT6aaC3wske5Izzf2NnVshd6OGZenS3QKE4bX1270JaslCckt9JBBtMJ-OKKG5jvPsQtHX6b6lKEzbCqh1L-jH9GXE_uqghudZes Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:10:03.108775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8084c097adde47ffadcacca8f4d3ea73", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: eaef8f72768e4d1daf21257fdaf580d2 Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.110538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '479d8f15-a236-4cc4-835b-ddbb3ab4569b'} Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:10:03.111449 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. Sep 09 23:10:03.112942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:03.114310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Returning 404 to user: Instance 479d8f15-a236-4cc4-835b-ddbb3ab4569b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:10:03.114310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5339fa0a-d2bf-4d3d-9d27-ac61edd8c8ae tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b" status: 404 len: 111 microversion: 2.20 time: 0.076809 Sep 09 23:10:03.114310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 456/898] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:10:03 2022] GET /compute/v2.1/servers/479d8f15-a236-4cc4-835b-ddbb3ab4569b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 23:10:03.136910 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8b270b1-c441-41cf-9455-de85562eb4e2 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa" status: 200 len: 352 microversion: 2.1 time: 0.086320 Sep 09 23:10:03.146782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 443/899] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:10:03 2022] GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:04.152853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1fb19315-5880-4c3d-863e-ea91144b8f69 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Calling method '.version_select at 0x7fcecf359040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:04.184002 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1fb19315-5880-4c3d-863e-ea91144b8f69 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] HTTP exception thrown: Volume 55f67704-79e0-4881-b0bd-5303db8038aa could not be found. Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1fb19315-5880-4c3d-863e-ea91144b8f69 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Request method failure captured: Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa HTTP/1.1 Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8fIdCBlY1exhMFi7uPBxnhMN0cWafH8p1iZW8W6HsBfxZLHiAU38uTRxu78oBfYFhVCxl2gr5VOKnnH7ymJDXz0v6j5pFHF-xASIcz_6_OXIrjdV3Sz1QEXBmsAWPa0vpRQ3zLhCjBAqm3VUuPCakiH53ghliVBvhhGaZqf6vWIWSE Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 8fbdd29bbd314ac683f35199c123662a Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesGetTestJSON-389104542 Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:10:04.186169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8fbdd29bbd314ac683f35199c123662a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8fbdd29bbd314ac683f35199c123662a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8fbdd29bbd314ac683f35199c123662a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8fbdd29bbd314ac683f35199c123662a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesGetTestJSON-389104542 Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 8fbdd29bbd314ac683f35199c123662a Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesGetTestJSON-389104542 Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesGetTestJSON-389104542-project Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 8d827112547b4b3095d838430fd58114 Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesGetTestJSON-389104542-project Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Volume 55f67704-79e0-4881-b0bd-5303db8038aa could not be found. Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '55f67704-79e0-4881-b0bd-5303db8038aa'} Sep 09 23:10:04.188325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55f67704-79e0-4881-b0bd-5303db8038aa could not be found. (HTTP 404) (Request-ID: req-d54311f4-e3da-4b3d-8da4-5e884c06511b) Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:04.189353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:10:04.191766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55f67704-79e0-4881-b0bd-5303db8038aa could not be found. Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 23:10:04.193342 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55f67704-79e0-4881-b0bd-5303db8038aa could not be found. Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55f67704-79e0-4881-b0bd-5303db8038aa could not be found. Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1fb19315-5880-4c3d-863e-ea91144b8f69 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] Returning 404 to user: Volume 55f67704-79e0-4881-b0bd-5303db8038aa could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1fb19315-5880-4c3d-863e-ea91144b8f69 tempest-VolumesGetTestJSON-389104542 tempest-VolumesGetTestJSON-389104542-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa" status: 404 len: 109 microversion: 2.1 time: 0.040930 Sep 09 23:10:04.194771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 457/900] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 23:10:04 2022] GET /compute/v2.1/os-volumes/55f67704-79e0-4881-b0bd-5303db8038aa => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:10:04.308100 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:04.308609 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:04.317163 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:04.317857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:04.318290 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:04.319196 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:04.319801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:04.320145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:04.338744 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] HTTP exception thrown: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Request method failure captured: Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb HTTP/1.1 Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8YM1Rph_Rjp-vagUJ1uQht2flZH2y96gSMQaiHJDvuz2h8rZ8KtOJjq0J_HCIVFBiJ7_nCG9IrkT6aaC3wske5Izzf2NnVshd6OGZenS3QKE4bX1270JaslCckt9JBBtMJ-OKKG5jvPsQtHX6b6lKEzbCqh1L-jH9GXE_uqghudZes Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:10:04.341872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8084c097adde47ffadcacca8f4d3ea73", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: eaef8f72768e4d1daf21257fdaf580d2 Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.343780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '2052a904-5812-447c-b0ac-d3c9dc4321cb'} Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:10:04.344633 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.346149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.349482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Returning 404 to user: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:10:04.350666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-86f89656-e31a-43fa-9a54-b520dede204c tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 404 len: 111 microversion: 2.20 time: 0.047553 Sep 09 23:10:04.352099 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 444/901] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 9 23:10:04 2022] DELETE /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:10:04.360353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:04.360966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] [instance: 2052a904-5812-447c-b0ac-d3c9dc4321cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:04.371381 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:04.372440 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:04.373357 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:04.374312 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:04.375982 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:04.377928 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:04.400869 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] HTTP exception thrown: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Request method failure captured: Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb HTTP/1.1 Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8YM1Rph_Rjp-vagUJ1uQht2flZH2y96gSMQaiHJDvuz2h8rZ8KtOJjq0J_HCIVFBiJ7_nCG9IrkT6aaC3wske5Izzf2NnVshd6OGZenS3QKE4bX1270JaslCckt9JBBtMJ-OKKG5jvPsQtHX6b6lKEzbCqh1L-jH9GXE_uqghudZes Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:10:04.403035 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8084c097adde47ffadcacca8f4d3ea73", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8084c097adde47ffadcacca8f4d3ea73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 8084c097adde47ffadcacca8f4d3ea73 Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-395823223 Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: eaef8f72768e4d1daf21257fdaf580d2 Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-395823223-project Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.404451 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '2052a904-5812-447c-b0ac-d3c9dc4321cb'} Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:10:04.405505 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. Sep 09 23:10:04.407260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:10:04.410326 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] Returning 404 to user: Instance 2052a904-5812-447c-b0ac-d3c9dc4321cb could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:10:04.411476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e8d2297-9c00-40ef-bfc6-a9beab6b6ed5 tempest-AttachVolumeShelveTestJSON-395823223 tempest-AttachVolumeShelveTestJSON-395823223-project] 10.222.0.17 "GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb" status: 404 len: 111 microversion: 2.20 time: 0.055570 Sep 09 23:10:04.412579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 458/902] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 23:10:04 2022] GET /compute/v2.1/servers/2052a904-5812-447c-b0ac-d3c9dc4321cb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:10:12.593273 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2059611327", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89000540", "security_groups": [{"name": "tempest-secgroup-smoke-2135557599"}], "block_device_mapping_v2": [{"uuid": "7deb6059-211f-4856-a674-cf626513e53b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9445547a-ea9c-4c43-a619-716b862ad991"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:12.617309 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:12.832930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] validate_networks() for [('9445547a-ea9c-4c43-a619-716b862ad991', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:10:13.604088 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:10:13.605184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:10:13.606159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:10:13.607199 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:10:13.607199 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:10:13.616757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:13.617486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:13.617981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:13.618878 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:13.619546 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:13.620160 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:13.628320 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:13.649279 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Getting quotas for project 82213ebf52f24af49758dd17e5e1d129. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:10:13.654276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Getting quotas for user 3cbefab6dddb45c381158126d203f66b and project 82213ebf52f24af49758dd17e5e1d129. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:10:13.762006 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:10:13.764519 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7deb6059-211f-4856-a674-cf626513e53b',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:10:13.884408 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c5ff5eef-fa7a-40db-bb71-34393969cdf0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Action: 'create', calling method: .version_select at 0x7fcecf3595e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-629369020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKKD739lm9zaFJH3u0Vsvu07yNnjcjSVG3BRp4bqS77mh6YU8uRcwsNvl2CZOd3FtRt7TCxzq6Kw8JHv0KpqtFToWgq9QQ1vokMCERrQLmmsxfVHoJk+GK73rVFn9Ayzw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:13.918067 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-c5ff5eef-fa7a-40db-bb71-34393969cdf0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Getting quotas for project f68efb39c9f649d6a0e2bc424b418cbd. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:10:13.922807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-c5ff5eef-fa7a-40db-bb71-34393969cdf0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Getting quotas for user b339e5581cf044d9a55eb85561a58106 and project f68efb39c9f649d6a0e2bc424b418cbd. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:10:13.976447 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c5ff5eef-fa7a-40db-bb71-34393969cdf0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.375651 Sep 09 23:10:13.977739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 459/903] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:10:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:13.993773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f22125c0-e60f-4066-9e03-b24fb14a1614 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.405898 Sep 09 23:10:13.994693 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 445/904] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:10:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:10:14.008960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a12cb42-19d3-46ce-b8c5-e30ac2927ffa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:14.009968 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3a12cb42-19d3-46ce-b8c5-e30ac2927ffa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:14.386942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:14.608367 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a12cb42-19d3-46ce-b8c5-e30ac2927ffa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:14.621898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a12cb42-19d3-46ce-b8c5-e30ac2927ffa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1093 microversion: 2.1 time: 0.618875 Sep 09 23:10:14.622805 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 460/905] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:14 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1093 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:15.658889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:15.659617 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:15.672871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:15.673617 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:15.674234 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:15.675362 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:15.676005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:15.676629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:15.861166 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:15.872998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dce6f802-2be7-4529-aab6-00d5828d013a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1143 microversion: 2.1 time: 0.228050 Sep 09 23:10:15.888116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 446/906] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:15 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1143 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:16.897250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:16.898540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:16.913964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:16.915599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:16.918165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:16.920649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:16.921729 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:16.922700 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:17.087826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:17.104046 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-268400f1-3712-418a-9057-8b6bc7c3d511 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1191 microversion: 2.1 time: 0.210336 Sep 09 23:10:17.105185 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 461/907] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:16 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1191 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:18.132628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:18.134219 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:18.159226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:18.160277 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:18.161843 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:18.164776 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:18.166520 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:18.167216 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:18.300326 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:18.322216 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97102d12-310d-4c96-bce9-756d02e08fd0 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1209 microversion: 2.1 time: 0.193797 Sep 09 23:10:18.326512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 447/908] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:18 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1209 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:19.186844 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-146986be-24d5-4c11-a2e6-3e1f574871f5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'create', calling method: .version_select at 0x7fcecf3593a0>, body: {"keypair": {"name": "tempest-keypair-412607382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy4XgK18UANw+F/wG4tqE4Wj6p91uSTT05P0/j1jJMytDVZrHJ5sFSX6jkW0tqa/NqrW1BsUwUvk5LsLHKuX1SYRCBc3OTvpLdXDdoaNIdpbMmoY7sUl1LmIbeBlMBnhw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:19.192413 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:19.216621 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-146986be-24d5-4c11-a2e6-3e1f574871f5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Getting quotas for project f319bdd0037244749fb635d82729b782. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:10:19.223161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-146986be-24d5-4c11-a2e6-3e1f574871f5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Getting quotas for user 26bf037a0dd84ca9b46d8e2693de8bc4 and project f319bdd0037244749fb635d82729b782. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:10:19.254971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-146986be-24d5-4c11-a2e6-3e1f574871f5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173085 Sep 09 23:10:19.256612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 462/909] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:10:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:19.352463 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:19.353181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:19.360920 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:19.363811 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:19.368953 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:19.383753 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:19.385389 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:19.388718 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:19.747425 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:19.757121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f29e6467-e878-460e-b4bf-2d1519fb8719 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.408833 Sep 09 23:10:19.758267 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 448/910] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:19 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:20.293854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f8a403f7-c55f-4918-86da-73483e88218d req-8fd0e9b0-409e-4046-9431-2bad3450b84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c356050-d654-4832-b36c-1a190276ad32", "tag": "5bd1406f-e8f8-4762-9f42-8de814f9db50"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:20.307380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f8a403f7-c55f-4918-86da-73483e88218d req-8fd0e9b0-409e-4046-9431-2bad3450b84b service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:20.313578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f8a403f7-c55f-4918-86da-73483e88218d req-8fd0e9b0-409e-4046-9431-2bad3450b84b service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:20.313578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f8a403f7-c55f-4918-86da-73483e88218d req-8fd0e9b0-409e-4046-9431-2bad3450b84b service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:20.322260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f8a403f7-c55f-4918-86da-73483e88218d req-8fd0e9b0-409e-4046-9431-2bad3450b84b service nova] Creating event network-changed:5bd1406f-e8f8-4762-9f42-8de814f9db50 for instance 8c356050-d654-4832-b36c-1a190276ad32 on hv-cinder-85221 Sep 09 23:10:20.327925 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f8a403f7-c55f-4918-86da-73483e88218d req-8fd0e9b0-409e-4046-9431-2bad3450b84b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038515 Sep 09 23:10:20.329116 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 463/911] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:20.787478 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:20.788307 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:20.799958 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:20.800803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:20.801415 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:20.802343 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:20.803027 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:20.803558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:21.040301 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:21.049430 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3100c34-e56b-4d2e-b162-de4c9d603269 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.272095 Sep 09 23:10:21.067514 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 449/912] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:20 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:21.263915 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-468095818", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ad3c4f1-128f-476d-83c6-d034333af424"}], "security_groups": [{"name": "tempest-securitygroup--751739060"}], "key_name": "tempest-keypair-412607382", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:21.454602 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] validate_networks() for [('4ad3c4f1-128f-476d-83c6-d034333af424', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:10:22.089758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:22.095301 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:22.109231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:22.111048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:22.111938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:22.114011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:22.114982 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:22.115764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:22.169546 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:10:22.169969 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:10:22.170441 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:10:22.171402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:10:22.172551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:10:22.186502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:22.187457 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:22.188176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:22.189292 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:22.190118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:22.190787 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:22.211773 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Getting quotas for project f319bdd0037244749fb635d82729b782. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:10:22.219311 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Getting quotas for user 26bf037a0dd84ca9b46d8e2693de8bc4 and project f319bdd0037244749fb635d82729b782. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:10:22.243140 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:10:22.246400 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:10:22.313811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36d551f0-63aa-49ca-9ed3-57ddbf758915 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.054756 Sep 09 23:10:22.315081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 464/913] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:10:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:10:22.343519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e805d8b-1cb3-43f1-8687-7f52b9d31bd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:22.343519 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e805d8b-1cb3-43f1-8687-7f52b9d31bd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:22.406547 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e805d8b-1cb3-43f1-8687-7f52b9d31bd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:22.414230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e805d8b-1cb3-43f1-8687-7f52b9d31bd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1236 microversion: 2.1 time: 0.081457 Sep 09 23:10:22.415170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 465/914] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:22 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1236 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:22.460671 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:22.472114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ad43e89-2009-4de3-a8d8-0155f7e65c72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.391450 Sep 09 23:10:22.473241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 450/915] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:22 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:23.438919 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:23.439763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:23.449649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:23.454445 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:23.455624 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:23.456404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:23.456951 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:23.457710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:23.510131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:23.511444 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:23.533345 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:23.533850 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:23.534279 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:23.535196 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:23.535962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:23.536387 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:23.555029 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:23.567321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-daf70e33-f8d9-44e5-b299-9cb5ccf97ae7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1288 microversion: 2.1 time: 0.132900 Sep 09 23:10:23.580718 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 466/916] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:23 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1288 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:23.629573 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:23.663349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:23.881795 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:23.899084 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c479d04-20d7-4c5a-9d56-9295f3ae7861 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.406825 Sep 09 23:10:23.916367 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 451/917] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:23 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:24.593542 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:24.594960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:24.602795 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:24.603650 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:24.604258 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:24.605230 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:24.606061 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:24.606767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:24.807965 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:24.822647 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b360a867-448f-4dca-9080-5e04c04a8735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1361 microversion: 2.1 time: 0.233700 Sep 09 23:10:24.836472 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 467/918] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:24 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:24.922742 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:24.923356 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:24.936110 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:24.937563 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:24.938587 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:24.939834 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:24.940534 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:24.941054 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:25.180908 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:25.190420 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91cf6f55-87a0-4301-b001-e8fcdd821521 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.272030 Sep 09 23:10:25.190998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 452/919] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:24 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:25.626731 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-62d91ca6-e25c-49a1-811e-03a46886ee4c req-fabb6da8-38b6-4478-8322-e649d23a3710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "450cc210-345e-42fa-9601-36d94a7ecf31", "tag": "c4bbcb3b-d538-4851-9546-47e3cb74e228"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:25.644961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62d91ca6-e25c-49a1-811e-03a46886ee4c req-fabb6da8-38b6-4478-8322-e649d23a3710 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:25.645738 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62d91ca6-e25c-49a1-811e-03a46886ee4c req-fabb6da8-38b6-4478-8322-e649d23a3710 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:25.646260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62d91ca6-e25c-49a1-811e-03a46886ee4c req-fabb6da8-38b6-4478-8322-e649d23a3710 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:25.658138 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-62d91ca6-e25c-49a1-811e-03a46886ee4c req-fabb6da8-38b6-4478-8322-e649d23a3710 service nova] Creating event network-changed:c4bbcb3b-d538-4851-9546-47e3cb74e228 for instance 450cc210-345e-42fa-9601-36d94a7ecf31 on hv-cinder-85221 Sep 09 23:10:25.663429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-62d91ca6-e25c-49a1-811e-03a46886ee4c req-fabb6da8-38b6-4478-8322-e649d23a3710 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040858 Sep 09 23:10:25.664532 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 468/920] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:25.846869 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:25.847800 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:25.853988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:25.854610 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:25.855051 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:25.855791 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:25.856254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:25.856697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:26.088523 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:26.097973 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-498485ae-41f7-4c69-b250-a93654750dc5 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1361 microversion: 2.1 time: 0.254910 Sep 09 23:10:26.098976 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 453/921] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:25 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:10:26.214911 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:26.215736 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:26.223382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:26.223997 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:26.224508 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:26.225300 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:26.225827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:26.226288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:26.393988 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:26.404418 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47ae4420-7ed3-4a04-8eae-c36d6e536efa tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.194076 Sep 09 23:10:26.406020 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 469/922] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:26 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:27.120802 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:27.121415 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:27.128428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:27.128913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:27.129352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:27.130036 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:27.130494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:27.130918 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:27.293810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:27.301945 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-676b6e8a-97a2-46ce-a7db-ad8c1a2570c4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1361 microversion: 2.1 time: 0.185034 Sep 09 23:10:27.302516 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 454/923] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:27 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:27.429414 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:27.430019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:27.442414 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:27.442900 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:27.443528 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:27.444404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:27.444860 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:27.445281 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:27.595285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:27.603370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72838da9-768f-44c6-99be-2d30a5bc5d61 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.178122 Sep 09 23:10:27.603879 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 470/924] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:27 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:28.325398 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:28.326000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:28.332285 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:28.332759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:28.333193 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:28.333876 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:28.334326 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:28.334829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:28.467082 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:28.477032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04db3eb8-b330-4be1-ba42-6336bdea45b0 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1361 microversion: 2.1 time: 0.155112 Sep 09 23:10:28.477967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 455/925] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:28 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:28.630552 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:28.631165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:28.637176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:28.637675 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:28.638124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:28.638824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:28.639325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:28.639782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:28.782034 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:28.792386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae2d8f6c-950a-4dc4-9ceb-98371d5ef106 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.170034 Sep 09 23:10:28.793122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 471/926] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:28 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:29.501547 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:29.502250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:29.508942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:29.509534 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:29.509978 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:29.510671 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:29.511131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:29.511593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:29.641558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:29.649091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a25d8aef-f58c-429c-a731-cff5a0ac1f4c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1361 microversion: 2.1 time: 0.151544 Sep 09 23:10:29.649662 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 456/927] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:29 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:29.817094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:29.817710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:29.824284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:29.824771 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:29.825211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:29.825906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:29.826368 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:29.827413 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:29.962822 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:29.971866 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-855710ee-2a8d-4c48-bc9d-e7917326bb04 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.158498 Sep 09 23:10:29.972427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 472/928] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:29 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:30.641326 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-43479c09-36c1-4e9e-99cf-52e411bb4ff9 req-28460add-1136-4cf5-8ab1-de5d317be081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "450cc210-345e-42fa-9601-36d94a7ecf31", "name": "network-vif-plugged", "status": "completed", "tag": "c4bbcb3b-d538-4851-9546-47e3cb74e228"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:30.653018 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-43479c09-36c1-4e9e-99cf-52e411bb4ff9 req-28460add-1136-4cf5-8ab1-de5d317be081 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:30.653955 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-43479c09-36c1-4e9e-99cf-52e411bb4ff9 req-28460add-1136-4cf5-8ab1-de5d317be081 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:30.654359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-43479c09-36c1-4e9e-99cf-52e411bb4ff9 req-28460add-1136-4cf5-8ab1-de5d317be081 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:30.671419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-43479c09-36c1-4e9e-99cf-52e411bb4ff9 req-28460add-1136-4cf5-8ab1-de5d317be081 service nova] Creating event network-vif-plugged:c4bbcb3b-d538-4851-9546-47e3cb74e228 for instance 450cc210-345e-42fa-9601-36d94a7ecf31 on hv-cinder-85221 Sep 09 23:10:30.678396 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-43479c09-36c1-4e9e-99cf-52e411bb4ff9 req-28460add-1136-4cf5-8ab1-de5d317be081 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042898 Sep 09 23:10:30.680384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 457/929] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:30.682214 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:30.683872 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:30.697692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:30.701627 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:30.702608 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:30.704142 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:30.705812 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:30.706975 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:30.879052 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:30.888863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76313dcb-098e-4290-a61d-d802c72ada44 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1361 microversion: 2.1 time: 0.219769 Sep 09 23:10:30.889978 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 473/930] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:30 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:30.994914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:30.995646 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:31.001801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:31.002294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:31.002729 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:31.003429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:31.004030 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:31.004632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:31.135812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:31.144225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-43446d47-7d6c-4943-8f84-67bb0667fb7f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.153488 Sep 09 23:10:31.144911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 458/931] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:30 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:31.912112 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:31.912721 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:31.919084 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:31.919594 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:31.920034 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:31.920757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:31.921209 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:31.921628 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:32.052848 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:32.061782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52a20e3d-c4e3-48ce-8f6a-cb72c059637a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1361 microversion: 2.1 time: 0.152919 Sep 09 23:10:32.062350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 474/932] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:31 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:32.167628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:32.168271 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:32.175578 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:32.176095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:32.176516 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:32.177213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:32.177673 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:32.178104 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:32.326862 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:32.335524 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d373484-b74c-4014-a255-33957441911b tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.171451 Sep 09 23:10:32.351902 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 459/933] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:32 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:32.693128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-47229ca3-a26e-4017-b92e-8cf612cbfcc0 req-ff1455ed-c0e4-4c74-8186-d4b5bcd96a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c356050-d654-4832-b36c-1a190276ad32", "name": "network-vif-plugged", "status": "completed", "tag": "5bd1406f-e8f8-4762-9f42-8de814f9db50"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:32.698174 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:32.698998 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=18 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:32.705472 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47229ca3-a26e-4017-b92e-8cf612cbfcc0 req-ff1455ed-c0e4-4c74-8186-d4b5bcd96a9e service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:32.705944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47229ca3-a26e-4017-b92e-8cf612cbfcc0 req-ff1455ed-c0e4-4c74-8186-d4b5bcd96a9e service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:32.706384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47229ca3-a26e-4017-b92e-8cf612cbfcc0 req-ff1455ed-c0e4-4c74-8186-d4b5bcd96a9e service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:32.718599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-47229ca3-a26e-4017-b92e-8cf612cbfcc0 req-ff1455ed-c0e4-4c74-8186-d4b5bcd96a9e service nova] Creating event network-vif-plugged:5bd1406f-e8f8-4762-9f42-8de814f9db50 for instance 8c356050-d654-4832-b36c-1a190276ad32 on hv-cinder-85221 Sep 09 23:10:32.723694 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-47229ca3-a26e-4017-b92e-8cf612cbfcc0 req-ff1455ed-c0e4-4c74-8186-d4b5bcd96a9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034256 Sep 09 23:10:32.724295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 475/934] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:32.848902 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1887389947", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-629369020", "security_groups": [{"name": "tempest-secgroup-smoke-554680045"}], "networks": [{"uuid": "e360911e-34fd-4fb5-b9bd-39ae203d1077"}], "block_device_mapping_v2": [{"uuid": "da352f0c-e320-4ba2-90c1-943585d789ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:32.986504 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] validate_networks() for [('e360911e-34fd-4fb5-b9bd-39ae203d1077', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:10:33.087118 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:33.087926 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:33.094581 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:33.095257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:33.095933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:33.096642 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:33.097274 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:33.097709 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:33.273964 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:33.284952 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7aa03d8e-7955-4ec9-a3ed-add02d118ec2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1547 microversion: 2.1 time: 0.202496 Sep 09 23:10:33.285537 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 476/935] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:33 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1547 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:33.310043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:33.310469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:33.318754 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:33.319688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:33.320360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:33.321394 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:33.321923 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:33.322365 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:33.417426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b042998-a3f4-492a-aaeb-9bbbb93df120 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113498 Sep 09 23:10:33.418261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 477/936] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 23:10:33 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:10:33.423031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:33.423666 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:33.431592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:33.432294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:33.432925 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:33.433800 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:33.434612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:33.435201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:33.754248 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:10:33.754754 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:10:33.755253 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:10:33.755767 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:10:33.756282 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:10:33.765715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:33.766270 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:33.766776 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:33.767605 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:33.768134 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:33.768441 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:33.768620 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:33.777013 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3753a1f6-ba2e-430e-b56b-529189fd7265 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1265 microversion: 2.1 time: 0.357276 Sep 09 23:10:33.786346 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Getting quotas for project f68efb39c9f649d6a0e2bc424b418cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:10:33.791192 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Getting quotas for user b339e5581cf044d9a55eb85561a58106 and project f68efb39c9f649d6a0e2bc424b418cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:10:33.792546 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 478/937] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:33 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1265 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:33.850685 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:10:33.853231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da352f0c-e320-4ba2-90c1-943585d789ed',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:10:33.994525 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-28756faa-da83-45ff-a3c7-97f0d8ea91dd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.149378 Sep 09 23:10:34.003586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 460/938] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:10:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:10:34.007096 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc89e81e-85fb-4685-a1ac-8feb4958e7ee tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:34.007866 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc89e81e-85fb-4685-a1ac-8feb4958e7ee tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:34.086280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc89e81e-85fb-4685-a1ac-8feb4958e7ee tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:34.095831 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc89e81e-85fb-4685-a1ac-8feb4958e7ee tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1088 microversion: 2.1 time: 0.092670 Sep 09 23:10:34.097300 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 479/939] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:34 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1088 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:10:34.803715 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:34.805345 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:34.814001 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:34.815948 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:34.817090 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:34.818068 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:34.818820 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:34.819619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:34.944991 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-bd4f5d81-8e9b-4ba9-b55d-176321b82315 req-d5fd2124-c4c2-4d5e-8490-ab573c67c32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "450cc210-345e-42fa-9601-36d94a7ecf31", "tag": "c4bbcb3b-d538-4851-9546-47e3cb74e228"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:34.961085 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd4f5d81-8e9b-4ba9-b55d-176321b82315 req-d5fd2124-c4c2-4d5e-8490-ab573c67c32c service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:34.961886 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd4f5d81-8e9b-4ba9-b55d-176321b82315 req-d5fd2124-c4c2-4d5e-8490-ab573c67c32c service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:34.962571 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd4f5d81-8e9b-4ba9-b55d-176321b82315 req-d5fd2124-c4c2-4d5e-8490-ab573c67c32c service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:34.977359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-bd4f5d81-8e9b-4ba9-b55d-176321b82315 req-d5fd2124-c4c2-4d5e-8490-ab573c67c32c service nova] Creating event network-changed:c4bbcb3b-d538-4851-9546-47e3cb74e228 for instance 450cc210-345e-42fa-9601-36d94a7ecf31 on hv-cinder-85221 Sep 09 23:10:34.983689 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-bd4f5d81-8e9b-4ba9-b55d-176321b82315 req-d5fd2124-c4c2-4d5e-8490-ab573c67c32c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044973 Sep 09 23:10:34.984637 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 480/940] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:10:35.125188 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:35.126558 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:35.136590 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:35.137389 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:35.147178 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:35.148927 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:35.149767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:35.150562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:35.160241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:35.171790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-561c2d81-6ac6-477b-aeda-ad6e94436a72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1453 microversion: 2.1 time: 0.371380 Sep 09 23:10:35.172787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 461/941] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:34 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1453 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:35.194478 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:35.195077 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:35.201172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:35.202089 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:35.202692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:35.203576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:35.204194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:35.204780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:35.237816 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:35.248255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd58e4f9-3b73-4ccb-b2a2-70e22fa0b59d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1186 microversion: 2.1 time: 0.128631 Sep 09 23:10:35.248947 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 481/942] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:35 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1186 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:35.872377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:35.885406 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-720d34fe-f1f7-454d-9698-0e03e7e1b3cd tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1453 microversion: 2.1 time: 0.694673 Sep 09 23:10:35.886535 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 462/943] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:35 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1453 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:10:36.273416 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:36.274029 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:36.281590 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:36.282083 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:36.282524 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:36.283224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:36.305268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:36.305268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:36.486238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:36.494810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec0ef82c-50de-4848-bcb8-ba22df1cdc60 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1204 microversion: 2.1 time: 0.225182 Sep 09 23:10:36.500716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 482/944] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:36 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1204 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:37.528182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:37.530974 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:37.538471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:37.540011 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:37.540701 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:37.542070 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:37.542891 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:37.543568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:37.855283 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:37.857848 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:37.865643 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42db5df2-b627-4ef6-963a-e9b53e9c53ab tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.341635 Sep 09 23:10:37.875678 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 463/945] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:37 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:38.027912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3935c826-8bc0-4b42-aa9a-bd190f1d6304 req-27c4ee84-ce6d-4e41-ba7c-45d1d6e3ee29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa1dfa7-90d0-4992-a5ba-90694d0c61a8", "tag": "d6d1f015-bc7f-4e62-8e56-7e56e18dc3de"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:38.040201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3935c826-8bc0-4b42-aa9a-bd190f1d6304 req-27c4ee84-ce6d-4e41-ba7c-45d1d6e3ee29 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:38.041042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3935c826-8bc0-4b42-aa9a-bd190f1d6304 req-27c4ee84-ce6d-4e41-ba7c-45d1d6e3ee29 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:38.041782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3935c826-8bc0-4b42-aa9a-bd190f1d6304 req-27c4ee84-ce6d-4e41-ba7c-45d1d6e3ee29 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:38.054469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3935c826-8bc0-4b42-aa9a-bd190f1d6304 req-27c4ee84-ce6d-4e41-ba7c-45d1d6e3ee29 service nova] Creating event network-changed:d6d1f015-bc7f-4e62-8e56-7e56e18dc3de for instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 on hv-cinder-85221 Sep 09 23:10:38.059912 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3935c826-8bc0-4b42-aa9a-bd190f1d6304 req-27c4ee84-ce6d-4e41-ba7c-45d1d6e3ee29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036176 Sep 09 23:10:38.071588 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 483/946] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:38.317559 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0bc1478e-7b4b-45a3-9963-6d52be0c02ef req-b5cc97d8-b564-43c8-93b7-8eaa17dcf3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c356050-d654-4832-b36c-1a190276ad32", "tag": "5bd1406f-e8f8-4762-9f42-8de814f9db50"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:38.327327 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0bc1478e-7b4b-45a3-9963-6d52be0c02ef req-b5cc97d8-b564-43c8-93b7-8eaa17dcf3b3 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:38.327857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0bc1478e-7b4b-45a3-9963-6d52be0c02ef req-b5cc97d8-b564-43c8-93b7-8eaa17dcf3b3 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:38.328286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0bc1478e-7b4b-45a3-9963-6d52be0c02ef req-b5cc97d8-b564-43c8-93b7-8eaa17dcf3b3 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:38.339159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0bc1478e-7b4b-45a3-9963-6d52be0c02ef req-b5cc97d8-b564-43c8-93b7-8eaa17dcf3b3 service nova] Creating event network-changed:5bd1406f-e8f8-4762-9f42-8de814f9db50 for instance 8c356050-d654-4832-b36c-1a190276ad32 on hv-cinder-85221 Sep 09 23:10:38.344245 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0bc1478e-7b4b-45a3-9963-6d52be0c02ef req-b5cc97d8-b564-43c8-93b7-8eaa17dcf3b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030540 Sep 09 23:10:38.348010 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 464/947] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:38.889884 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:38.890808 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:38.897179 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:38.897665 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:38.898320 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:38.899345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:38.900042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:38.900724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:39.105180 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:39.108962 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:39.114789 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b9c4739-ece6-46ce-85dc-d3badb6857d4 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.229268 Sep 09 23:10:39.126459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 484/948] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:38 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:40.138768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:40.139798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:40.153164 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:40.153652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:40.154086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:40.155289 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:40.155770 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:40.156195 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:40.293627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:40.301884 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af543c6f-179e-40e2-8319-a3e4bc6fe5de tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.168491 Sep 09 23:10:40.302439 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 465/949] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:40 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:41.326012 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:41.327136 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:41.334288 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:41.334810 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:41.335250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:41.335969 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:41.336425 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:41.336851 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:41.477386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:41.485293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-490b98ee-c197-4aa3-bb92-29c439ff7937 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.163654 Sep 09 23:10:41.485862 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 485/950] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:41 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:42.507827 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:42.508471 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:42.515198 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:42.515800 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:42.516315 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:42.517148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:42.517705 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:42.518311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:42.723473 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:42.731225 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cba3f85a-7e51-4f43-ab2e-6112ea4f6f04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.227293 Sep 09 23:10:42.732260 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 466/951] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:42 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:43.754380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:43.755176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:43.763151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:43.763684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:43.764619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:43.765325 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:43.765870 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:43.766378 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:43.908949 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:43.917833 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ea41aec-5592-401d-a864-0b117b71a836 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.167360 Sep 09 23:10:43.918462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 486/952] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:43 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:44.940975 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:44.941583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:44.943998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:44.944653 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:44.945308 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:44.951586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:44.952074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:44.952511 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:44.953204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:44.953660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:44.954092 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:45.095339 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:45.102959 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e437c91-9b5b-46ce-9b26-907ccb993a6a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.165895 Sep 09 23:10:45.103541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 467/953] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:44 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:46.125478 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:46.126254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:46.128151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:46.134043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:46.134534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:46.134974 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:46.135698 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:46.136187 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:46.136612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:46.273985 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:46.281624 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-60ecc0fc-ec3e-490d-bbc7-87ff055f8bcf tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.159984 Sep 09 23:10:46.282195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 487/954] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:46 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:47.305103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:47.305813 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:47.312156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:47.312640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:47.313074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:47.313756 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:47.314211 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:47.314664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:47.451890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:47.459879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7dda9b5-91e9-4ebc-b70b-ff90a063c60d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.158866 Sep 09 23:10:47.460441 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 468/955] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:47 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:48.483221 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:48.484069 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:48.491652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:48.492146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:48.492586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:48.493296 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:48.493757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:48.494189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:48.557399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-95f82831-4895-4e83-b8b3-a850a9f16a4a req-a124a373-ac60-425a-b1b6-ced9c7849d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa1dfa7-90d0-4992-a5ba-90694d0c61a8", "name": "network-vif-plugged", "status": "completed", "tag": "d6d1f015-bc7f-4e62-8e56-7e56e18dc3de"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:48.570488 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-95f82831-4895-4e83-b8b3-a850a9f16a4a req-a124a373-ac60-425a-b1b6-ced9c7849d76 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:48.571056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-95f82831-4895-4e83-b8b3-a850a9f16a4a req-a124a373-ac60-425a-b1b6-ced9c7849d76 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:48.571602 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-95f82831-4895-4e83-b8b3-a850a9f16a4a req-a124a373-ac60-425a-b1b6-ced9c7849d76 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:48.583764 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-95f82831-4895-4e83-b8b3-a850a9f16a4a req-a124a373-ac60-425a-b1b6-ced9c7849d76 service nova] Creating event network-vif-plugged:d6d1f015-bc7f-4e62-8e56-7e56e18dc3de for instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 on hv-cinder-85221 Sep 09 23:10:48.588894 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-95f82831-4895-4e83-b8b3-a850a9f16a4a req-a124a373-ac60-425a-b1b6-ced9c7849d76 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036702 Sep 09 23:10:48.590032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 469/956] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:10:48.631051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:48.639294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-588b918a-3726-4042-be56-1ea51be7ee7d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.159416 Sep 09 23:10:48.639851 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 488/957] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:48 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:49.663161 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:49.663884 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:49.669931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:49.670350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:49.670839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:49.671535 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:49.672048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:49.672463 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:49.817050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:49.824686 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2a8a1d2-e31d-416d-9824-207bbe9ba16c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1259 microversion: 2.1 time: 0.166211 Sep 09 23:10:49.825242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 470/958] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:49 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:50.847685 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:50.848304 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:50.850301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:10:50.855285 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:50.855817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:50.856257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:50.856960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:50.857418 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:50.857855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:51.032743 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:51.040701 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-560ea300-69db-44e9-a279-bb7cfdafe4ae tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1442 microversion: 2.1 time: 0.196853 Sep 09 23:10:51.041250 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 489/959] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:50 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1442 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:51.064343 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:51.064970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:51.072037 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:51.072526 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:51.072968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:51.073849 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:51.074707 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:51.075148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:51.209968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:51.217640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1dff6fd9-fe05-472d-a73c-ee6e60d0927f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1442 microversion: 2.1 time: 0.157802 Sep 09 23:10:51.218197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 471/960] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:51 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:10:53.268853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-98cb84c0-ef73-4f90-8aa3-cb83f3a98c42 req-eeef838a-68d5-4771-96c2-28f089c47308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa1dfa7-90d0-4992-a5ba-90694d0c61a8", "tag": "d6d1f015-bc7f-4e62-8e56-7e56e18dc3de"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:53.278710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-98cb84c0-ef73-4f90-8aa3-cb83f3a98c42 req-eeef838a-68d5-4771-96c2-28f089c47308 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:53.278925 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-98cb84c0-ef73-4f90-8aa3-cb83f3a98c42 req-eeef838a-68d5-4771-96c2-28f089c47308 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:53.279763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-98cb84c0-ef73-4f90-8aa3-cb83f3a98c42 req-eeef838a-68d5-4771-96c2-28f089c47308 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:53.290917 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-98cb84c0-ef73-4f90-8aa3-cb83f3a98c42 req-eeef838a-68d5-4771-96c2-28f089c47308 service nova] Creating event network-changed:d6d1f015-bc7f-4e62-8e56-7e56e18dc3de for instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 on hv-cinder-85221 Sep 09 23:10:53.296486 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-98cb84c0-ef73-4f90-8aa3-cb83f3a98c42 req-eeef838a-68d5-4771-96c2-28f089c47308 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031239 Sep 09 23:10:53.297412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 490/961] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:10:55.903255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2125613688", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "networks": [{"uuid": "1132f49f-2c7b-456d-b60d-f1cbfa07afa6"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:55.956761 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] validate_networks() for [('1132f49f-2c7b-456d-b60d-f1cbfa07afa6', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:10:56.306645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:10:56.307062 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:10:56.307557 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:10:56.307961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:10:56.308366 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:10:56.317059 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:56.317535 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:56.317961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:56.318724 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:56.319131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:56.319573 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:56.336071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Getting quotas for project 460da1ec0c6a40eeb0e3760d1ee7b33f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:10:56.339967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Getting quotas for user 3d213252fb6a49ed9e026365f7945509 and project 460da1ec0c6a40eeb0e3760d1ee7b33f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:10:56.351182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:10:56.353434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:10:56.399329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-27671daa-0244-40c7-b63b-e573b0ab163a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499917 Sep 09 23:10:56.400021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 472/962] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:10:56.412826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-059d884c-2fb1-4fe6-b276-b09f61d4bb34 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:56.413726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-059d884c-2fb1-4fe6-b276-b09f61d4bb34 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:56.469484 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-059d884c-2fb1-4fe6-b276-b09f61d4bb34 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:56.476928 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-059d884c-2fb1-4fe6-b276-b09f61d4bb34 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1214 microversion: 2.1 time: 0.068794 Sep 09 23:10:56.477506 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 491/963] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:56 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:57.499123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:57.499859 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:57.506397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:57.506888 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:57.507319 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:57.508215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:57.508670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:57.509098 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:57.571418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:57.579669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66ed5cef-a643-4e4d-80be-48a688342e81 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1266 microversion: 2.1 time: 0.084978 Sep 09 23:10:57.580233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 473/964] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:57 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:58.610223 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:58.610843 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:58.618028 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:58.618514 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:58.618948 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:58.619676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:58.620133 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:58.620558 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:58.752426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:58.760333 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2c18727-b1f7-4937-8f83-79fc5e7259b6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1314 microversion: 2.1 time: 0.154043 Sep 09 23:10:58.760898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 492/965] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:58 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:10:59.294388 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3c3cd865-68cf-47b2-ae46-1c5f349592e6 req-b7ee11a5-0a43-49e9-aefb-d311c2fe1b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45900c0e-95d1-42f4-b216-4c2b50913d7c", "tag": "f5a6cbe2-c53b-45fd-9f22-2adb28051b39"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:10:59.306546 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3c3cd865-68cf-47b2-ae46-1c5f349592e6 req-b7ee11a5-0a43-49e9-aefb-d311c2fe1b24 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:59.307029 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3c3cd865-68cf-47b2-ae46-1c5f349592e6 req-b7ee11a5-0a43-49e9-aefb-d311c2fe1b24 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:59.307466 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3c3cd865-68cf-47b2-ae46-1c5f349592e6 req-b7ee11a5-0a43-49e9-aefb-d311c2fe1b24 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:59.319478 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3c3cd865-68cf-47b2-ae46-1c5f349592e6 req-b7ee11a5-0a43-49e9-aefb-d311c2fe1b24 service nova] Creating event network-changed:f5a6cbe2-c53b-45fd-9f22-2adb28051b39 for instance 45900c0e-95d1-42f4-b216-4c2b50913d7c on hv-cinder-85221 Sep 09 23:10:59.324377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3c3cd865-68cf-47b2-ae46-1c5f349592e6 req-b7ee11a5-0a43-49e9-aefb-d311c2fe1b24 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034905 Sep 09 23:10:59.324970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 474/966] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:10:59.783704 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:10:59.784352 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:10:59.790683 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:59.791170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:59.791636 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:59.792350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:10:59.792790 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:10:59.793217 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:10:59.920727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:10:59.928688 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2526149-ff06-459c-82f3-a8c2f254952d tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1314 microversion: 2.1 time: 0.148981 Sep 09 23:10:59.929255 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 493/967] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:10:59 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:00.953303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:00.954009 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:00.961021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:00.961511 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:00.961951 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:00.962647 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:00.963103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:00.963550 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:01.178754 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:01.187093 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fabf4b4-c3fb-4e56-9da7-667f37c4d36c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1314 microversion: 2.1 time: 0.238534 Sep 09 23:11:01.187690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 475/968] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:00 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:02.210120 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:02.210731 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:02.217238 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:02.217712 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:02.218141 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:02.218819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:02.219267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:02.219716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:02.345154 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:02.352721 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-628df04e-8e05-45b6-974f-42594058bfba tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1314 microversion: 2.1 time: 0.146506 Sep 09 23:11:02.353279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 494/969] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:02 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:03.375971 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:03.376582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:03.383117 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:03.383639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:03.384073 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:03.384758 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:03.385213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:03.385638 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:03.515380 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:03.523042 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9698ed5-4f1c-4e3c-9f24-1748519aadbf tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1314 microversion: 2.1 time: 0.150938 Sep 09 23:11:03.523624 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 476/970] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:03 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:04.546425 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:04.547170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:04.553750 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:04.554232 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:04.554920 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:04.555637 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:04.556092 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:04.556512 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:04.590492 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cabe53e7-9c23-4237-b8bf-62bdfc8c5200 req-aac26efc-78c1-40b5-b090-621d869bec25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45900c0e-95d1-42f4-b216-4c2b50913d7c", "name": "network-vif-plugged", "status": "completed", "tag": "f5a6cbe2-c53b-45fd-9f22-2adb28051b39"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:04.604172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cabe53e7-9c23-4237-b8bf-62bdfc8c5200 req-aac26efc-78c1-40b5-b090-621d869bec25 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:04.604650 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cabe53e7-9c23-4237-b8bf-62bdfc8c5200 req-aac26efc-78c1-40b5-b090-621d869bec25 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:04.605337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cabe53e7-9c23-4237-b8bf-62bdfc8c5200 req-aac26efc-78c1-40b5-b090-621d869bec25 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:04.616664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cabe53e7-9c23-4237-b8bf-62bdfc8c5200 req-aac26efc-78c1-40b5-b090-621d869bec25 service nova] Creating event network-vif-plugged:f5a6cbe2-c53b-45fd-9f22-2adb28051b39 for instance 45900c0e-95d1-42f4-b216-4c2b50913d7c on hv-cinder-85221 Sep 09 23:11:04.621508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cabe53e7-9c23-4237-b8bf-62bdfc8c5200 req-aac26efc-78c1-40b5-b090-621d869bec25 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034750 Sep 09 23:11:04.622520 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 477/971] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:11:04.694160 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:04.703015 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aff28e24-77f1-4fbd-9d05-28a3c746aeeb tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1314 microversion: 2.1 time: 0.161185 Sep 09 23:11:04.703710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 495/972] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:04 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:05.726893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:05.727526 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:05.734086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:05.735238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:05.735698 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:05.736383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:05.736835 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:05.737254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:05.865181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:05.872814 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9655e69-fa6e-4977-a1f6-4896a201313c tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1314 microversion: 2.1 time: 0.150372 Sep 09 23:11:05.873380 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 478/973] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:05 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:06.895323 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:06.895971 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:06.898392 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:06.903847 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:06.904333 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:06.904767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:06.905455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:06.905911 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:06.906336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:07.031164 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:07.038906 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8598949c-e77f-43f9-bfa8-e52422fc9fcc tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1497 microversion: 2.1 time: 0.147480 Sep 09 23:11:07.039466 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 496/974] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:06 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:07.583672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:07.584205 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:07.586121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:07.586767 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:07.593007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:07.593493 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:07.593927 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:07.594622 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:07.595083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:07.596153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:07.622841 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:11:07.696063 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bc876d8-db60-40d6-9c23-bc05f1fd0b9e tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 204 len: 0 microversion: 2.1 time: 0.116362 Sep 09 23:11:07.696570 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 479/975] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:11:07 2022] DELETE /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:11:07.706552 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:07.707169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:07.713132 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:07.713620 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:07.714052 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:07.714763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:07.715198 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:07.715650 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:07.844896 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:07.853643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b81b4548-4c75-4b95-91a0-94c74c5269c6 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1503 microversion: 2.1 time: 0.152686 Sep 09 23:11:07.854211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 497/976] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:07 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:08.876328 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:08.877027 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:08.883341 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:08.883850 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:08.884281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:08.884990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:08.885438 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:08.885857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:08.889785 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:09.025829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:09.033336 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10f29797-9004-4a7f-aa46-d6b15822cb6a tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1503 microversion: 2.1 time: 0.161291 Sep 09 23:11:09.034540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 480/977] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:08 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:10.057904 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:10.058574 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:10.066677 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:10.067261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:10.067905 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:10.068895 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:10.069439 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:10.069932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:10.085634 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-859f16fb-e870-4ac8-9d57-9dc73831614c req-f42105a1-1664-4199-957a-7948b4ba5159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45900c0e-95d1-42f4-b216-4c2b50913d7c", "name": "network-vif-deleted", "tag": "f5a6cbe2-c53b-45fd-9f22-2adb28051b39"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:10.096538 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-859f16fb-e870-4ac8-9d57-9dc73831614c req-f42105a1-1664-4199-957a-7948b4ba5159 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:10.097105 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-859f16fb-e870-4ac8-9d57-9dc73831614c req-f42105a1-1664-4199-957a-7948b4ba5159 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:10.097605 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-859f16fb-e870-4ac8-9d57-9dc73831614c req-f42105a1-1664-4199-957a-7948b4ba5159 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:10.120925 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-859f16fb-e870-4ac8-9d57-9dc73831614c req-f42105a1-1664-4199-957a-7948b4ba5159 service nova] Creating event network-vif-deleted:f5a6cbe2-c53b-45fd-9f22-2adb28051b39 for instance 45900c0e-95d1-42f4-b216-4c2b50913d7c on hv-cinder-85221 Sep 09 23:11:10.127148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-859f16fb-e870-4ac8-9d57-9dc73831614c req-f42105a1-1664-4199-957a-7948b4ba5159 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045130 Sep 09 23:11:10.128303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 481/978] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:11:10.143718 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:10.151442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bab02f70-9423-440b-8244-d295e34ba4c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 200 len: 1461 microversion: 2.1 time: 0.098456 Sep 09 23:11:10.152032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 498/979] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:10 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:11.176625 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:11.177355 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 45900c0e-95d1-42f4-b216-4c2b50913d7c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:11.184297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:11.184781 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:11.185215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:11.185909 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:11.186367 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:11.186793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:11.202914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] HTTP exception thrown: Instance 45900c0e-95d1-42f4-b216-4c2b50913d7c could not be found. Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Request method failure captured: Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c HTTP/1.1 Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8f-fsrA-JD2IeZJXqB4irsEdh4NPHWEA2ycWD_SN-4V5iNzxkmKVz534ZXLaqsCOEBuq3UeOvOpBdre7F31bNBynUUQ8mv3N6xbSXfJ7wb1jGZQNwvM0Pk2rgbM_LY-HRiacp9B385rALtf-sEYYM_i88UOiTloMtNOpCPtfafsud0 Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 460da1ec0c6a40eeb0e3760d1ee7b33f Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesActionsTest-2118046837 Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:11:11.204598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/460da1ec0c6a40eeb0e3760d1ee7b33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/460da1ec0c6a40eeb0e3760d1ee7b33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_460da1ec0c6a40eeb0e3760d1ee7b33f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/460da1ec0c6a40eeb0e3760d1ee7b33f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesActionsTest-2118046837 Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 460da1ec0c6a40eeb0e3760d1ee7b33f Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesActionsTest-2118046837 Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesActionsTest-2118046837-project Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 3d213252fb6a49ed9e026365f7945509 Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesActionsTest-2118046837-project Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 45900c0e-95d1-42f4-b216-4c2b50913d7c could not be found. Sep 09 23:11:11.206384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '45900c0e-95d1-42f4-b216-4c2b50913d7c'} Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45900c0e-95d1-42f4-b216-4c2b50913d7c could not be found. Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:11:11.207314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45900c0e-95d1-42f4-b216-4c2b50913d7c could not be found. Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45900c0e-95d1-42f4-b216-4c2b50913d7c could not be found. Sep 09 23:11:11.208912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:11.210168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Returning 404 to user: Instance 45900c0e-95d1-42f4-b216-4c2b50913d7c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:11:11.210168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35b71d91-9d29-493f-a18e-adab5b7d4421 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c" status: 404 len: 111 microversion: 2.1 time: 0.034173 Sep 09 23:11:11.210168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 482/980] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:11 2022] GET /compute/v2.1/servers/45900c0e-95d1-42f4-b216-4c2b50913d7c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:11:11.255087 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1442422598", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "networks": [{"uuid": "1132f49f-2c7b-456d-b60d-f1cbfa07afa6"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:11.307780 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] validate_networks() for [('1132f49f-2c7b-456d-b60d-f1cbfa07afa6', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:11:11.609630 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:11.610118 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:11.616481 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:11.616969 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:11.617406 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:11.618094 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:11.618552 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:11.618981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:11.643776 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af49c312-b9fe-4910-a127-12272aa67c6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/ips" status: 200 len: 145 microversion: 2.1 time: 0.038002 Sep 09 23:11:11.644330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 483/981] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:11:11 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:11:11.653374 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:11:11.653797 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:11:11.654266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:11:11.654672 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:11:11.655081 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:11:11.664352 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:11.664827 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:11.665259 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:11.665975 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:11.666427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:11.666848 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:11.672370 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=75 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:11.685634 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Getting quotas for project 460da1ec0c6a40eeb0e3760d1ee7b33f. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:11:11.689687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Getting quotas for user 3d213252fb6a49ed9e026365f7945509 and project 460da1ec0c6a40eeb0e3760d1ee7b33f. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:11:11.700722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:11:11.703142 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:11:11.749615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b04e81d-ad6c-4a11-84f7-719c6ebf9f80 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498964 Sep 09 23:11:11.750264 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 499/982] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:11:11.761627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0287ac01-10d7-4a01-ad91-db7d57aa27c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:11.762235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0287ac01-10d7-4a01-ad91-db7d57aa27c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:11.817332 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0287ac01-10d7-4a01-ad91-db7d57aa27c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:11.824078 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0287ac01-10d7-4a01-ad91-db7d57aa27c3 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1214 microversion: 2.1 time: 0.066501 Sep 09 23:11:11.824637 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 484/983] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:11 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:12.847064 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:12.847741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:12.856620 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:12.857141 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:12.857559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:12.858286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:12.858746 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:12.859174 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:12.922321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:12.931718 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-977eaaaa-7ee8-4207-9c31-d4570bbf4cad tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1266 microversion: 2.1 time: 0.089043 Sep 09 23:11:12.932293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 500/984] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:12 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:13.956219 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:13.956765 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:13.962997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:13.963479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:13.963945 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:13.964638 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:13.965095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:13.965528 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:14.165558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:14.173259 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f7ff1aea-5893-4a7c-bfd0-7aac656aa1dd tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1314 microversion: 2.1 time: 0.221747 Sep 09 23:11:14.173822 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 485/985] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:13 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:14.435583 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9a3f6c29-b70b-4d29-ad2a-7de430f39afb req-b345ee53-07ae-4f96-b284-9d48e81a4f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8dc7d9-e84a-4af5-846f-58ee84e8d579", "tag": "95feb525-401c-4a1a-8cd6-d3ababc9ecae"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:14.445684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a3f6c29-b70b-4d29-ad2a-7de430f39afb req-b345ee53-07ae-4f96-b284-9d48e81a4f77 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:14.446166 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a3f6c29-b70b-4d29-ad2a-7de430f39afb req-b345ee53-07ae-4f96-b284-9d48e81a4f77 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:14.446599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a3f6c29-b70b-4d29-ad2a-7de430f39afb req-b345ee53-07ae-4f96-b284-9d48e81a4f77 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:14.457786 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9a3f6c29-b70b-4d29-ad2a-7de430f39afb req-b345ee53-07ae-4f96-b284-9d48e81a4f77 service nova] Creating event network-changed:95feb525-401c-4a1a-8cd6-d3ababc9ecae for instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 on hv-cinder-85221 Sep 09 23:11:14.462961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9a3f6c29-b70b-4d29-ad2a-7de430f39afb req-b345ee53-07ae-4f96-b284-9d48e81a4f77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031560 Sep 09 23:11:14.463670 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 501/986] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:11:14.686232 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01a1ae77-0344-4938-a4a6-1297684a2402"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:14.688574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:14.694563 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:14.695051 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:14.695505 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:14.696212 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:14.696670 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:14.697095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:14.973667 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e039b70c-264b-4a5f-ba37-4fdd18523a43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291172 Sep 09 23:11:14.974353 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 486/987] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:11:14 2022] POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:11:15.198908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:15.199563 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:15.206237 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:15.206724 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:15.207165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:15.207921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:15.208384 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:15.208816 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:15.340359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:15.347942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ab844bc-86c6-4a9f-8ace-734a356bf15f tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1314 microversion: 2.1 time: 0.153430 Sep 09 23:11:15.348511 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 502/988] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:15 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:16.371947 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:16.372639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:16.374514 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:16.380696 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:16.381179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:16.381610 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:16.382294 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:16.382771 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:16.383214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:16.514613 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:16.524062 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b8f96c4-42b2-4b63-95df-3707bf27d580 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1314 microversion: 2.1 time: 0.156751 Sep 09 23:11:16.524558 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 487/989] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:16 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:17.548676 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:17.549848 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:17.556541 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:17.557031 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:17.557468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:17.558159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:17.558611 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:17.559036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:17.685402 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:17.693124 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d94a0879-193b-4e1b-8b5d-4a701400cda9 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1314 microversion: 2.1 time: 0.148380 Sep 09 23:11:17.693720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 503/990] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:17 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:18.715155 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:18.715903 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:18.723080 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:18.723598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:18.724039 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:18.724743 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:18.725197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:18.725623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:18.855701 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:18.863190 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e5026b0-4d54-4e39-9d6b-5115f807ba48 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1314 microversion: 2.1 time: 0.152105 Sep 09 23:11:18.863776 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 488/991] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:18 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:19.885476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:19.886033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:19.891942 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:19.892422 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:19.893490 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:19.894176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:19.894627 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:19.895047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:20.022866 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:20.030493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df43f53b-5239-4628-b786-1f5003a1efc2 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1314 microversion: 2.1 time: 0.149080 Sep 09 23:11:20.031059 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 504/992] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:19 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:20.673819 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c3ac40dc-47ec-4f67-809d-236859a269f8 req-f523d242-e7fb-4dee-b19b-a47bd6b6e09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8dc7d9-e84a-4af5-846f-58ee84e8d579", "name": "network-vif-plugged", "status": "completed", "tag": "95feb525-401c-4a1a-8cd6-d3ababc9ecae"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:20.684895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c3ac40dc-47ec-4f67-809d-236859a269f8 req-f523d242-e7fb-4dee-b19b-a47bd6b6e09c service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:20.685373 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c3ac40dc-47ec-4f67-809d-236859a269f8 req-f523d242-e7fb-4dee-b19b-a47bd6b6e09c service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:20.685811 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c3ac40dc-47ec-4f67-809d-236859a269f8 req-f523d242-e7fb-4dee-b19b-a47bd6b6e09c service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:20.696744 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c3ac40dc-47ec-4f67-809d-236859a269f8 req-f523d242-e7fb-4dee-b19b-a47bd6b6e09c service nova] Creating event network-vif-plugged:95feb525-401c-4a1a-8cd6-d3ababc9ecae for instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 on hv-cinder-85221 Sep 09 23:11:20.701476 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c3ac40dc-47ec-4f67-809d-236859a269f8 req-f523d242-e7fb-4dee-b19b-a47bd6b6e09c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Sep 09 23:11:20.702082 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 489/993] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:11:21.053190 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:21.053845 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:21.056583 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:21.062211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:21.062706 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:21.063150 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:21.063875 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:21.064339 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:21.064769 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:21.192271 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:21.199855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3c41bd0-71c7-4c5e-b5ee-19dae7c82238 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1314 microversion: 2.1 time: 0.150555 Sep 09 23:11:21.200427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 505/994] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:21 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:22.222588 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:22.226835 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:22.227561 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:22.234091 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:22.234574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:22.235014 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:22.235739 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:22.236199 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:22.237290 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:22.366366 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:22.373920 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b88d0066-dff7-42fd-b152-521ca5c35050 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1314 microversion: 2.1 time: 0.153270 Sep 09 23:11:22.374487 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 490/995] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:22 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:23.396759 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:23.397328 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:23.399195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:23.399969 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:23.406193 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:23.406681 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:23.407121 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:23.407855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:23.408339 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:23.408732 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:23.542376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:23.551196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8d945df-71a4-417e-b482-100eab025749 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1497 microversion: 2.1 time: 0.158355 Sep 09 23:11:23.551945 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 506/996] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:23 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:11:23.583533 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca55ecc8-4bbb-4199-9905-39864f3d9405 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:23.589896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca55ecc8-4bbb-4199-9905-39864f3d9405 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:23.590384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca55ecc8-4bbb-4199-9905-39864f3d9405 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:23.590823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca55ecc8-4bbb-4199-9905-39864f3d9405 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:23.653666 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca55ecc8-4bbb-4199-9905-39864f3d9405 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Going to try to stop instance {{(pid=120603) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 23:11:23.698823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca55ecc8-4bbb-4199-9905-39864f3d9405 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/action" status: 202 len: 0 microversion: 2.1 time: 0.118898 Sep 09 23:11:23.699435 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 491/997] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:11:23 2022] POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:11:23.708197 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:23.708854 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:23.714811 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:23.715335 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:23.715825 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:23.716702 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:23.717376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:23.718032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:23.862355 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:23.870621 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-687b7ee6-3165-4739-98f3-8894abe0a019 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.166728 Sep 09 23:11:23.871191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 507/998] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:23 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:24.123710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:24.124302 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:24.130941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:24.131429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:24.131907 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:24.132601 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:24.133081 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:24.133497 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:24.157632 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:11:24.234771 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-07e4f619-f0d5-4efa-9500-f2d423866711 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 204 len: 0 microversion: 2.1 time: 0.114907 Sep 09 23:11:24.235412 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 492/999] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:11:24 2022] DELETE /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:11:24.244530 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:24.245506 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:24.251822 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:24.252855 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:24.253293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:24.253987 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:24.254443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:24.254867 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:24.382279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:24.390033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1eb5fadb-0e9d-4aa9-ace8-50feba0f5e03 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1503 microversion: 2.1 time: 0.149424 Sep 09 23:11:24.390686 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 508/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:24 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:24.896400 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:24.897095 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:24.904328 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:24.904808 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:24.905239 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:24.905933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:24.906384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:24.906807 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:25.039392 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:25.047512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38263f74-f2c9-48f3-a493-efd2501f6f58 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.155918 Sep 09 23:11:25.048090 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 493/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:24 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:25.414051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:25.414671 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:25.421114 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:25.421599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:25.422038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:25.422732 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:25.423196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:25.423668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:25.560611 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:25.568708 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74a23218-4daf-4dc0-8c54-b6fe3d6643d8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1503 microversion: 2.1 time: 0.158417 Sep 09 23:11:25.569440 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 509/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:25 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:26.071675 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:26.072482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:26.078927 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:26.079419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:26.079894 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:26.081425 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:26.081913 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:26.082344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:26.289184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:26.297372 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0dbd6a1d-1714-45ca-b133-4841b077b4ea tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.230386 Sep 09 23:11:26.297936 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 494/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:26 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:26.501069 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-356594ab-12ad-4a75-9801-45a4f06556ee req-89ab50ba-038c-4a66-b31d-49742b857646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8dc7d9-e84a-4af5-846f-58ee84e8d579", "name": "network-vif-deleted", "tag": "95feb525-401c-4a1a-8cd6-d3ababc9ecae"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:26.512203 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-356594ab-12ad-4a75-9801-45a4f06556ee req-89ab50ba-038c-4a66-b31d-49742b857646 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:26.512692 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-356594ab-12ad-4a75-9801-45a4f06556ee req-89ab50ba-038c-4a66-b31d-49742b857646 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:26.513741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-356594ab-12ad-4a75-9801-45a4f06556ee req-89ab50ba-038c-4a66-b31d-49742b857646 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:26.525616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-356594ab-12ad-4a75-9801-45a4f06556ee req-89ab50ba-038c-4a66-b31d-49742b857646 service nova] Creating event network-vif-deleted:95feb525-401c-4a1a-8cd6-d3ababc9ecae for instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 on hv-cinder-85221 Sep 09 23:11:26.530501 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-356594ab-12ad-4a75-9801-45a4f06556ee req-89ab50ba-038c-4a66-b31d-49742b857646 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033122 Sep 09 23:11:26.531072 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 510/1004] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:11:26.592574 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:26.593216 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:26.599617 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:26.600106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:26.600548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:26.601237 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:26.601693 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:26.602116 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:26.667102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d213252fb6a49ed9e026365f7945509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460da1ec0c6a40eeb0e3760d1ee7b33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:26.676841 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c617936-4d17-45b0-bd74-213bd22e2cd8 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 200 len: 1299 microversion: 2.1 time: 0.088259 Sep 09 23:11:26.677418 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 495/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:26 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:27.321762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:27.322463 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:27.328669 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:27.329148 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:27.329580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:27.330882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:27.331334 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:27.331786 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:27.460800 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:27.468950 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c8f40f58-52a8-42fe-b960-1af07765904b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.151615 Sep 09 23:11:27.469514 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 511/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:27 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:27.703167 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:27.703735 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] [instance: 2b8dc7d9-e84a-4af5-846f-58ee84e8d579] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:27.710090 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:27.710652 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:27.711021 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:27.711855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:27.712310 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:27.712732 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:27.715374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:27.727961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] HTTP exception thrown: Instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 could not be found. Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Request method failure captured: Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 HTTP/1.1 Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8f-fsrA-JD2IeZJXqB4irsEdh4NPHWEA2ycWD_SN-4V5iNzxkmKVz534ZXLaqsCOEBuq3UeOvOpBdre7F31bNBynUUQ8mv3N6xbSXfJ7wb1jGZQNwvM0Pk2rgbM_LY-HRiacp9B385rALtf-sEYYM_i88UOiTloMtNOpCPtfafsud0 Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 460da1ec0c6a40eeb0e3760d1ee7b33f Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesActionsTest-2118046837 Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:11:27.729586 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/460da1ec0c6a40eeb0e3760d1ee7b33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/460da1ec0c6a40eeb0e3760d1ee7b33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_460da1ec0c6a40eeb0e3760d1ee7b33f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/460da1ec0c6a40eeb0e3760d1ee7b33f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesActionsTest-2118046837 Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 460da1ec0c6a40eeb0e3760d1ee7b33f Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesActionsTest-2118046837 Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesActionsTest-2118046837-project Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 3d213252fb6a49ed9e026365f7945509 Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesActionsTest-2118046837-project Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 could not be found. Sep 09 23:11:27.730963 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '2b8dc7d9-e84a-4af5-846f-58ee84e8d579'} Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 could not be found. Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:11:27.732318 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 could not be found. Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 could not be found. Sep 09 23:11:27.733576 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:11:27.735463 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] Returning 404 to user: Instance 2b8dc7d9-e84a-4af5-846f-58ee84e8d579 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:11:27.735463 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7bd6d5e2-3174-4ac1-b180-2e33a8755649 tempest-VolumesActionsTest-2118046837 tempest-VolumesActionsTest-2118046837-project] 10.222.0.17 "GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579" status: 404 len: 111 microversion: 2.1 time: 0.031757 Sep 09 23:11:27.735463 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 496/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:27 2022] GET /compute/v2.1/servers/2b8dc7d9-e84a-4af5-846f-58ee84e8d579 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:11:28.491616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:28.492237 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:28.498661 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:28.499146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:28.499613 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:28.500320 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:28.500773 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:28.501202 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:28.628525 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:28.636821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-351434e0-cf22-46db-b598-ef2b082792e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.149128 Sep 09 23:11:28.637391 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 512/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:28 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:29.660921 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:29.661460 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:29.668134 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:29.668613 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:29.669046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:29.669721 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:29.670172 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:29.670593 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:29.799981 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:29.808391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a05ac04-aba5-480f-9352-97fb3dab5c60 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.151997 Sep 09 23:11:29.808951 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 497/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:29 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:30.832693 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:30.833307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:30.839850 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:30.840336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:30.840775 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:30.841464 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:30.841921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:30.842350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:30.971769 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:30.979902 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e0dd551-5377-4021-bec6-9ffe2b3b219c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.151522 Sep 09 23:11:30.980476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 513/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:30 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:32.002801 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:32.003322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:32.009731 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:32.010213 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:32.010650 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:32.011329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:32.011810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:32.012236 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:32.144034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:32.152071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77bc1c79-e70b-4085-8b18-2771e6d79817 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.153252 Sep 09 23:11:32.152629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 498/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:31 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:33.176380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:33.177586 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:33.184590 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:33.185299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:33.186280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:33.187181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:33.187739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:33.188174 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:33.340094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:33.353570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a33e1f67-8e6b-4a3b-a093-343e8a56a531 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.181590 Sep 09 23:11:33.354480 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 514/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:33 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:34.378582 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:34.379214 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:34.386226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:34.386987 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:34.387455 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:34.388175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:34.388623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:34.389215 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:34.565355 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:34.576546 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7376bd5a-9538-43ce-a5c4-e89ade8dad7f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.202695 Sep 09 23:11:34.596549 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 499/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:34 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:35.606818 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:35.610914 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:35.619598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:35.620452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:35.621021 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:35.621864 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:35.622452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:35.622985 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:35.801549 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:35.810473 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-885f56a1-473f-4351-b42b-b17762c335f2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.208058 Sep 09 23:11:35.813208 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 515/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:35 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:36.836508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:36.837798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:36.844838 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:36.845548 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:36.846166 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:36.846865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:36.847322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:36.847773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:36.984537 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:36.994150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd46a67c-901d-46de-a322-79e39c0824e9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.161491 Sep 09 23:11:37.009395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 500/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:36 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:11:38.018295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:38.019100 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:38.026378 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:38.027183 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:38.027876 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:38.028814 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:38.029308 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:38.029911 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:38.185527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:38.195034 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a29aa995-7b1d-48f2-83c5-83fa6324a466 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1721 microversion: 2.1 time: 0.180670 Sep 09 23:11:38.207851 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 516/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:38 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:39.222016 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:39.222700 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:39.229394 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:39.229886 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:39.230337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:39.231041 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:39.231536 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:39.231975 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:39.401697 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:39.412437 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-712b6869-ed24-4c04-8a12-a6de92c330ad tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1698 microversion: 2.1 time: 0.194949 Sep 09 23:11:39.419953 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 501/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:39 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1698 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:39.436352 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1598cad1-fd95-43c1-869a-130bbc983562 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:11:39.444990 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1598cad1-fd95-43c1-869a-130bbc983562 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:39.445736 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1598cad1-fd95-43c1-869a-130bbc983562 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:39.446403 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1598cad1-fd95-43c1-869a-130bbc983562 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:39.514749 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1598cad1-fd95-43c1-869a-130bbc983562 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Going to try to start instance {{(pid=120598) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 23:11:39.520177 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:11:39.568480 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1598cad1-fd95-43c1-869a-130bbc983562 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/action" status: 202 len: 0 microversion: 2.1 time: 0.136246 Sep 09 23:11:39.569168 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 517/1018] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:11:39 2022] POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:11:39.584061 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:39.586254 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:39.601467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:39.602281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:39.603058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:39.603955 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:39.604472 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:39.605151 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:39.843851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:39.853892 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0a1f9af-ac5f-40a0-beaa-89f18d5efcd4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1707 microversion: 2.1 time: 0.279954 Sep 09 23:11:39.854900 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 502/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:39 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1707 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:40.878970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:40.879941 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:40.887043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:40.888021 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:40.888803 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:40.890195 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:40.890901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:40.891665 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:41.055551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:41.064837 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7d87260-abdb-494b-a478-2b584ae14247 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1707 microversion: 2.1 time: 0.190300 Sep 09 23:11:41.071534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 518/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:40 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1707 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:11:42.094812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:11:42.096197 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:11:42.105719 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:42.106189 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:42.106629 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:42.107339 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:11:42.107845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:11:42.108276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:11:42.296979 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:11:42.307931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38d745cc-7530-4d81-81d9-c0089726c32f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1711 microversion: 2.1 time: 0.217367 Sep 09 23:11:42.308935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 503/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:11:42 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1711 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:20.886088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:20.886640 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:20.888889 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=27 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:12:20.889550 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:12:20.895720 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:20.896235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:20.896694 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:20.897380 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:20.897832 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:20.898254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:20.977326 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lazy-loading 'services' on Instance uuid 450cc210-345e-42fa-9601-36d94a7ecf31 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:12:21.046729 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d007fc01-8279-443f-8b36-5cc832c65ce7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/os-volume_attachments/01a1ae77-0344-4938-a4a6-1297684a2402" status: 202 len: 0 microversion: 2.1 time: 0.164397 Sep 09 23:12:21.047316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 519/1022] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:12:20 2022] DELETE /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/os-volume_attachments/01a1ae77-0344-4938-a4a6-1297684a2402 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:12:23.740351 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e08876b8-0b92-4f82-8e2a-3feb8c72e622 req-5ed1e809-fd9c-4336-86aa-c9163f3f4eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c356050-d654-4832-b36c-1a190276ad32", "tag": "5bd1406f-e8f8-4762-9f42-8de814f9db50"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:12:23.745599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:23.746142 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:23.748350 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:12:23.749000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=43 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:12:23.758381 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e08876b8-0b92-4f82-8e2a-3feb8c72e622 req-5ed1e809-fd9c-4336-86aa-c9163f3f4eb4 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:23.758865 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e08876b8-0b92-4f82-8e2a-3feb8c72e622 req-5ed1e809-fd9c-4336-86aa-c9163f3f4eb4 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:23.758996 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:23.759298 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e08876b8-0b92-4f82-8e2a-3feb8c72e622 req-5ed1e809-fd9c-4336-86aa-c9163f3f4eb4 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:23.759539 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:23.760300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:23.761149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:23.761643 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:23.762078 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:23.773413 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e08876b8-0b92-4f82-8e2a-3feb8c72e622 req-5ed1e809-fd9c-4336-86aa-c9163f3f4eb4 service nova] Creating event network-changed:5bd1406f-e8f8-4762-9f42-8de814f9db50 for instance 8c356050-d654-4832-b36c-1a190276ad32 on hv-cinder-85221 Sep 09 23:12:23.778457 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e08876b8-0b92-4f82-8e2a-3feb8c72e622 req-5ed1e809-fd9c-4336-86aa-c9163f3f4eb4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045705 Sep 09 23:12:23.779067 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 520/1023] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:12:23.795852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:12:23.875803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5db0e4fb-fe8f-4779-a0a3-7dc2fdc94280 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 204 len: 0 microversion: 2.1 time: 0.144936 Sep 09 23:12:23.876311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 504/1024] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:12:23 2022] DELETE /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:12:23.885333 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:23.886063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:23.892415 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:23.893406 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:23.893839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:23.894538 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:23.894994 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:23.895440 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:24.207358 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:24.215107 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f94226d0-b611-4528-be83-d5d08d3627c8 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.334153 Sep 09 23:12:24.215699 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 521/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:23 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:25.240917 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:25.241660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:25.248023 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:25.248497 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:25.248926 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:25.249639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:25.250086 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:25.250510 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:25.439273 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:25.447249 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83f214d1-e8d5-4af1-a151-5e0d2fa1b399 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.211270 Sep 09 23:12:25.447845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 505/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:25 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:26.470910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:26.471543 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:26.477945 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:26.478426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:26.478863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:26.479582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:26.480042 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:26.480467 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:26.614371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:26.622215 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c7012cef-fbc7-4a42-9358-84c7fcd9f08d tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.155154 Sep 09 23:12:26.622778 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 522/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:26 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:27.645594 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:27.646200 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:27.652568 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:27.653102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:27.653484 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:27.654163 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:27.654614 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:27.655034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:27.791157 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:27.799312 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a1b1787-da48-4a42-962a-792c1478e51f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.157148 Sep 09 23:12:27.799902 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 506/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:27 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:28.822898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:28.823534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:28.829849 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:28.830885 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:28.831321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:28.832043 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:28.832499 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:28.832936 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:28.959432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:28.967029 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a8d930ab-30c0-4911-a12a-1bdccec2ee69 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.147964 Sep 09 23:12:28.967629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 523/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:28 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:29.990187 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:29.990739 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:29.996759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:29.997238 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:29.997675 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:29.998359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:29.998816 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:29.999242 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:30.126622 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:30.134330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-660049dc-185f-4f52-91d8-325552184d81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.148183 Sep 09 23:12:30.134896 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 507/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:29 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:31.158672 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:31.159316 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:31.165739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:31.166217 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:31.166649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:31.167332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:31.167804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:31.168226 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:31.294368 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:31.302542 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f0fcaf0-9217-4a8f-a2e6-acb2d4acab81 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.148312 Sep 09 23:12:31.303110 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 524/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:31 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:32.326649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:32.327255 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:32.334867 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:32.335348 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:32.335991 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:32.337186 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:32.337684 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:32.338112 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:32.472034 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:32.479734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73b7b31f-0dcc-493c-ad37-211d3dba8e58 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.156916 Sep 09 23:12:32.480300 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 508/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:32 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:33.504294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:33.504918 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:33.511290 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:33.511822 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:33.512265 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:33.512966 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:33.513429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:33.513890 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:33.660823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:33.669159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca5ca23d-37cc-4cb9-bc0e-8d7ac90f528a tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1578 microversion: 2.1 time: 0.169291 Sep 09 23:12:33.669988 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 525/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:33 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:33.802852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25e885e4-f1c5-426c-91ec-9369894348dc tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:12:33.809672 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25e885e4-f1c5-426c-91ec-9369894348dc tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:33.810158 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25e885e4-f1c5-426c-91ec-9369894348dc tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:33.810597 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25e885e4-f1c5-426c-91ec-9369894348dc tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:33.833358 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-25e885e4-f1c5-426c-91ec-9369894348dc tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Going to try to stop instance {{(pid=120603) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 23:12:33.881472 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25e885e4-f1c5-426c-91ec-9369894348dc tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/action" status: 202 len: 0 microversion: 2.1 time: 0.082821 Sep 09 23:12:33.882083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 509/1034] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:12:33 2022] POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:12:33.890514 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:33.891265 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:33.898018 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:33.898589 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:33.899289 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:33.900148 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:33.900990 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:33.901635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:33.961799 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8b95981a-427c-4796-b110-73c2327e126e req-6afc5935-9604-4dc3-82de-64a4fdce8fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c356050-d654-4832-b36c-1a190276ad32", "name": "network-vif-deleted", "tag": "5bd1406f-e8f8-4762-9f42-8de814f9db50"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:12:33.973389 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b95981a-427c-4796-b110-73c2327e126e req-6afc5935-9604-4dc3-82de-64a4fdce8fd7 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:33.973847 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b95981a-427c-4796-b110-73c2327e126e req-6afc5935-9604-4dc3-82de-64a4fdce8fd7 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:33.974483 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b95981a-427c-4796-b110-73c2327e126e req-6afc5935-9604-4dc3-82de-64a4fdce8fd7 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:33.990267 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8b95981a-427c-4796-b110-73c2327e126e req-6afc5935-9604-4dc3-82de-64a4fdce8fd7 service nova] Creating event network-vif-deleted:5bd1406f-e8f8-4762-9f42-8de814f9db50 for instance 8c356050-d654-4832-b36c-1a190276ad32 on hv-cinder-85221 Sep 09 23:12:33.995331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8b95981a-427c-4796-b110-73c2327e126e req-6afc5935-9604-4dc3-82de-64a4fdce8fd7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038624 Sep 09 23:12:33.996152 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 510/1035] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:12:34.049233 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:34.057226 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d958fb77-cd72-4e95-97e8-fc2460fedaa1 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.170679 Sep 09 23:12:34.057798 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 526/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:33 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:34.693032 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:34.693727 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:34.699717 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:34.700194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:34.700625 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:34.701305 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:34.701754 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:34.702179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:34.733348 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:34.733468 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:34.733887 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:34.734324 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lazy-loading 'fault' on Instance uuid 8c356050-d654-4832-b36c-1a190276ad32 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:12:34.779311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:34.786823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a328439f-76bd-400b-b988-91efdf5dd2d3 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 200 len: 1229 microversion: 2.1 time: 0.097907 Sep 09 23:12:34.787378 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 511/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:34 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:35.080782 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:35.081376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:35.087721 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:35.088210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:35.088645 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:35.089363 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:35.089821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:35.090247 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:35.218480 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:35.226136 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca438552-c14a-4b8b-9ab5-04215692429b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.149851 Sep 09 23:12:35.226699 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 527/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:35 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:35.810249 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:35.810858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 8c356050-d654-4832-b36c-1a190276ad32] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:35.817241 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:35.817718 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:35.818151 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:35.818829 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:35.819286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:35.819738 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:35.832446 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] HTTP exception thrown: Instance 8c356050-d654-4832-b36c-1a190276ad32 could not be found. Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Request method failure captured: Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 HTTP/1.1 Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8ZZyLmnvWHQx1176xgyYPBbPDjUSvFr9-ug45Dza3VXeDiXZd7jxrtmrf614TFV0gucR9rtXZLn6akdNU4CeH7ldAbEp2L3EPfCiRnu36PDeU35ZNXlMLamsQs5H4R_UKpI8EeVFU5MZtpZZh8hzXQ84fuL9vI9CK3w5y-KNf8j0zw Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:12:35.834050 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_82213ebf52f24af49758dd17e5e1d129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 3cbefab6dddb45c381158126d203f66b Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 8c356050-d654-4832-b36c-1a190276ad32 could not be found. Sep 09 23:12:35.835768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '8c356050-d654-4832-b36c-1a190276ad32'} Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c356050-d654-4832-b36c-1a190276ad32 could not be found. Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:12:35.836818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c356050-d654-4832-b36c-1a190276ad32 could not be found. Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c356050-d654-4832-b36c-1a190276ad32 could not be found. Sep 09 23:12:35.838421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:35.840123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Returning 404 to user: Instance 8c356050-d654-4832-b36c-1a190276ad32 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:12:35.840123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8eb534e5-a4e8-4107-a0ef-a78397ad8903 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32" status: 404 len: 111 microversion: 2.1 time: 0.029057 Sep 09 23:12:35.840123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 512/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:35 2022] GET /compute/v2.1/servers/8c356050-d654-4832-b36c-1a190276ad32 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:12:36.249197 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:36.249833 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:36.256705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:36.257185 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:36.257638 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:36.258321 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:36.258772 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:36.259191 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:36.389219 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:36.397632 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82dcdf1d-7d29-48ce-a5f0-dfa7b432913a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.152233 Sep 09 23:12:36.398204 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 528/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:36 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:37.420553 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:37.421168 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:37.427599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:37.428089 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:37.428533 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:37.429229 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:37.429720 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:37.430404 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:37.560123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:37.567871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a88b6a8-94bc-448d-a259-e98c60435dc3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.151208 Sep 09 23:12:37.568461 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 513/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:37 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:38.591551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:38.592128 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:38.599106 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:38.599622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:38.600061 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:38.600763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:38.601224 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:38.601651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:38.730499 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:38.738908 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0195c0d6-749c-410f-a445-cf5047827a92 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.151379 Sep 09 23:12:38.739481 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 529/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:38 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:38.897477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:38.898037 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:38.905029 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:38.905516 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:38.906071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:38.906561 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3eae2425-f851-4558-91dc-93b8f7be8df6 req-505cb41c-d930-4153-9a17-a6bc7d736577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630c1ed5-3a51-4c57-86e9-b418f85887ee", "tag": "370eadb0-0d08-4853-b248-c2e6942c07c8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:12:38.906769 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:38.907218 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:38.908564 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:38.916826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3eae2425-f851-4558-91dc-93b8f7be8df6 req-505cb41c-d930-4153-9a17-a6bc7d736577 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:38.917648 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3eae2425-f851-4558-91dc-93b8f7be8df6 req-505cb41c-d930-4153-9a17-a6bc7d736577 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:38.918297 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3eae2425-f851-4558-91dc-93b8f7be8df6 req-505cb41c-d930-4153-9a17-a6bc7d736577 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:38.931584 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3eae2425-f851-4558-91dc-93b8f7be8df6 req-505cb41c-d930-4153-9a17-a6bc7d736577 service nova] Creating event network-changed:370eadb0-0d08-4853-b248-c2e6942c07c8 for instance 630c1ed5-3a51-4c57-86e9-b418f85887ee on hv-cinder-85221 Sep 09 23:12:38.937038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3eae2425-f851-4558-91dc-93b8f7be8df6 req-505cb41c-d930-4153-9a17-a6bc7d736577 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034176 Sep 09 23:12:38.937646 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 530/1043] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:12:38.939480 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:12:39.022818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e8b1c7b-553c-45db-93e1-745aaa83f4e2 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "DELETE /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 204 len: 0 microversion: 2.1 time: 0.129166 Sep 09 23:12:39.025450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 514/1044] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:12:38 2022] DELETE /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:12:39.034543 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:39.035293 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:39.041886 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:39.042376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:39.042813 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:39.043540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:39.044003 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:39.044429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:39.180100 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:39.187726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-349c44db-af0e-49ac-aca2-b649279e309c tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1578 microversion: 2.1 time: 0.157429 Sep 09 23:12:39.188298 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 531/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:39 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:39.762787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:39.763649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:39.769587 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:39.770153 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:39.770664 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:39.771428 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:39.771988 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:39.772505 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:39.909937 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:39.917935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f81e22f4-8d78-4674-a181-5ae722d51bd3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.159372 Sep 09 23:12:39.918503 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 515/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:39 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:40.210986 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:40.211570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:40.217863 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:40.218338 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:40.218764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:40.219462 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:40.219933 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:40.220932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:40.351853 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:40.359683 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f51f006f-24ac-40a1-85e7-225157fed044 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1578 microversion: 2.1 time: 0.152594 Sep 09 23:12:40.360261 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 532/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:40 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:40.942196 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:40.942824 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:40.949230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:40.949714 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:40.950150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:40.950857 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:40.951311 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:40.951768 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:41.173052 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:41.182292 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6f881f2-f78f-4f06-83f5-c29e4344399f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.244392 Sep 09 23:12:41.183180 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 516/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:40 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:41.385871 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:41.386480 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:41.393108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:41.393588 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:41.394020 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:41.394710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:41.395276 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:41.395629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:41.410502 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c5990b99-7c9f-4ca1-9dac-9f141bef23a5 req-dfa39d9d-bafc-408b-bbae-64c89892e796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630c1ed5-3a51-4c57-86e9-b418f85887ee", "name": "network-vif-deleted", "tag": "370eadb0-0d08-4853-b248-c2e6942c07c8"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:12:41.423203 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c5990b99-7c9f-4ca1-9dac-9f141bef23a5 req-dfa39d9d-bafc-408b-bbae-64c89892e796 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:41.424332 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c5990b99-7c9f-4ca1-9dac-9f141bef23a5 req-dfa39d9d-bafc-408b-bbae-64c89892e796 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:41.424970 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c5990b99-7c9f-4ca1-9dac-9f141bef23a5 req-dfa39d9d-bafc-408b-bbae-64c89892e796 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:41.431314 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:12:41.441845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c5990b99-7c9f-4ca1-9dac-9f141bef23a5 req-dfa39d9d-bafc-408b-bbae-64c89892e796 service nova] Creating event network-vif-deleted:370eadb0-0d08-4853-b248-c2e6942c07c8 for instance 630c1ed5-3a51-4c57-86e9-b418f85887ee on hv-cinder-85221 Sep 09 23:12:41.449813 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c5990b99-7c9f-4ca1-9dac-9f141bef23a5 req-dfa39d9d-bafc-408b-bbae-64c89892e796 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042011 Sep 09 23:12:41.450425 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 517/1049] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:12:41.469580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cbefab6dddb45c381158126d203f66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82213ebf52f24af49758dd17e5e1d129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:41.477469 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-456ccf03-2966-471a-9138-2f1887987d80 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 200 len: 1391 microversion: 2.1 time: 0.095412 Sep 09 23:12:41.478039 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 533/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:41 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:42.207904 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:42.208649 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:42.216248 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:42.216753 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:42.217204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:42.217911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:42.218369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:42.218797 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:42.359156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:42.369384 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d87bba2-cbd2-4771-aa95-5a02a14c4bb7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.166692 Sep 09 23:12:42.370056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 518/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:42 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:42.502909 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:42.503685 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: 630c1ed5-3a51-4c57-86e9-b418f85887ee] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:42.506008 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 23:12:42.506187 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Fri Sep 9 23:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee (ip 10.222.0.17) !!! Sep 09 23:12:42.513726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:42.514280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:42.514790 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:42.515649 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:42.516254 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:42.516776 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:42.531579 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] HTTP exception thrown: Instance 630c1ed5-3a51-4c57-86e9-b418f85887ee could not be found. Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Request method failure captured: Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee HTTP/1.1 Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8ZZyLmnvWHQx1176xgyYPBbPDjUSvFr9-ug45Dza3VXeDiXZd7jxrtmrf614TFV0gucR9rtXZLn6akdNU4CeH7ldAbEp2L3EPfCiRnu36PDeU35ZNXlMLamsQs5H4R_UKpI8EeVFU5MZtpZZh8hzXQ84fuL9vI9CK3w5y-KNf8j0zw Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:12:42.533245 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_82213ebf52f24af49758dd17e5e1d129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 3cbefab6dddb45c381158126d203f66b Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 630c1ed5-3a51-4c57-86e9-b418f85887ee could not be found. Sep 09 23:12:42.535143 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '630c1ed5-3a51-4c57-86e9-b418f85887ee'} Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630c1ed5-3a51-4c57-86e9-b418f85887ee could not be found. Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:12:42.536487 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630c1ed5-3a51-4c57-86e9-b418f85887ee could not be found. Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630c1ed5-3a51-4c57-86e9-b418f85887ee could not be found. Sep 09 23:12:42.538137 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:42.539804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Returning 404 to user: Instance 630c1ed5-3a51-4c57-86e9-b418f85887ee could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:12:42.539804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc78a214-2e45-4f59-921d-3b7a6ff00d72 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee" status: 404 len: 111 microversion: 2.1 time: 0.036464 Sep 09 23:12:42.539804 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 534/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:42 2022] GET /compute/v2.1/servers/630c1ed5-3a51-4c57-86e9-b418f85887ee => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:12:42.974113 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:42.974613 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:42.980377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:42.980862 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:42.981297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:42.981984 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:42.982434 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:42.982861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:42.996287 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] HTTP exception thrown: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Request method failure captured: Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 HTTP/1.1 Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8ZZyLmnvWHQx1176xgyYPBbPDjUSvFr9-ug45Dza3VXeDiXZd7jxrtmrf614TFV0gucR9rtXZLn6akdNU4CeH7ldAbEp2L3EPfCiRnu36PDeU35ZNXlMLamsQs5H4R_UKpI8EeVFU5MZtpZZh8hzXQ84fuL9vI9CK3w5y-KNf8j0zw Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:12:42.997911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_82213ebf52f24af49758dd17e5e1d129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 3cbefab6dddb45c381158126d203f66b Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:42.999627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'a0f3832e-f300-4e35-b871-2f2c9dc4cc83'} Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:12:43.000462 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:43.002395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.003790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Returning 404 to user: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:12:43.003790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ef5e955-9279-48f9-a872-17265022cf64 tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 404 len: 111 microversion: 2.1 time: 0.029010 Sep 09 23:12:43.003790 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 519/1053] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:12:42 2022] DELETE /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:12:43.008381 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:43.008993 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] [instance: a0f3832e-f300-4e35-b871-2f2c9dc4cc83] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:43.014830 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:43.015311 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:43.015778 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:43.016459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:43.016910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:43.017379 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:43.030265 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] HTTP exception thrown: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Request method failure captured: Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 HTTP/1.1 Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8ZZyLmnvWHQx1176xgyYPBbPDjUSvFr9-ug45Dza3VXeDiXZd7jxrtmrf614TFV0gucR9rtXZLn6akdNU4CeH7ldAbEp2L3EPfCiRnu36PDeU35ZNXlMLamsQs5H4R_UKpI8EeVFU5MZtpZZh8hzXQ84fuL9vI9CK3w5y-KNf8j0zw Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:12:43.031796 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_82213ebf52f24af49758dd17e5e1d129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/82213ebf52f24af49758dd17e5e1d129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 82213ebf52f24af49758dd17e5e1d129 Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-2118173664 Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 3cbefab6dddb45c381158126d203f66b Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-2118173664-project Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:43.034181 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'a0f3832e-f300-4e35-b871-2f2c9dc4cc83'} Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:12:43.034960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. Sep 09 23:12:43.036260 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:12:43.037395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Returning 404 to user: Instance a0f3832e-f300-4e35-b871-2f2c9dc4cc83 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:12:43.037395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25cc8a61-1b5d-4d28-a16b-7922db8fc52f tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83" status: 404 len: 111 microversion: 2.1 time: 0.029231 Sep 09 23:12:43.037395 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 535/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:43 2022] GET /compute/v2.1/servers/a0f3832e-f300-4e35-b871-2f2c9dc4cc83 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:12:43.394209 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:43.395074 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:43.402814 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:43.403298 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:43.403780 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:43.404479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:43.404936 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:43.405361 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:43.536914 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:43.544863 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b56f63ac-7fb5-45f1-94a7-b224e13f6389 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1675 microversion: 2.1 time: 0.155668 Sep 09 23:12:43.545429 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 520/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:43 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:12:44.350545 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-def71b4d-1fde-44a3-b9f0-fb419df724bf tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] Calling method '.version_select at 0x7fcecf79a3a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:44.382757 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-def71b4d-1fde-44a3-b9f0-fb419df724bf tempest-TestVolumeBootPattern-2118173664 tempest-TestVolumeBootPattern-2118173664-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-89000540" status: 202 len: 0 microversion: 2.1 time: 0.035717 Sep 09 23:12:44.384725 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 536/1056] 10.222.0.17 () {58 vars in 1257 bytes} [Fri Sep 9 23:12:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-89000540 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:12:44.570321 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:44.570926 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:44.577449 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:44.577939 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:44.578377 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:44.579082 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:44.579589 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:44.580019 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:44.602444 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 23:12:44.602714 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Fri Sep 9 23:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 (ip 10.222.0.17) !!! Sep 09 23:12:44.716626 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:44.725527 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9bafd840-e15f-456e-9b44-ec5d52e748ec tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1652 microversion: 2.1 time: 0.158998 Sep 09 23:12:44.726233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 521/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:44 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1652 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:44.750824 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9bbbba45-8cca-4293-be80-b2559c76d9cd tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:12:44.758237 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9bbbba45-8cca-4293-be80-b2559c76d9cd tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:44.758737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9bbbba45-8cca-4293-be80-b2559c76d9cd tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:44.759173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9bbbba45-8cca-4293-be80-b2559c76d9cd tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:44.782279 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9bbbba45-8cca-4293-be80-b2559c76d9cd tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Going to try to start instance {{(pid=120598) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 23:12:44.809033 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:12:44.831313 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9bbbba45-8cca-4293-be80-b2559c76d9cd tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/action" status: 202 len: 0 microversion: 2.1 time: 0.084583 Sep 09 23:12:44.831968 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 537/1058] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:12:44 2022] POST /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:12:44.840271 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:44.840893 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:44.848031 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:44.848618 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:44.849101 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:44.849848 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:44.850395 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:44.850851 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:44.991895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:44.999899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-43965a58-3cac-4fa4-a984-656cf098468b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1661 microversion: 2.1 time: 0.163440 Sep 09 23:12:45.000793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 522/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:44 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1661 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:46.023763 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:46.024466 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:46.030764 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:46.031249 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:46.031717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:46.032414 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:46.033359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:46.033786 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:46.183961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:46.193210 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c39322c0-21dc-49ae-aa1f-3677f6d77e6b tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1661 microversion: 2.1 time: 0.174168 Sep 09 23:12:46.193939 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 538/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:46 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1661 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:12:47.218968 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:47.221113 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:12:47.228344 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:47.229144 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:47.229793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:47.230690 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:47.231374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:47.232103 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:47.393467 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:12:47.402540 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e155051f-25d3-44b0-a561-b81eae124bff tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1665 microversion: 2.1 time: 0.189812 Sep 09 23:12:47.403102 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 523/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:12:47 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1665 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:02.968608 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:02.969170 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:02.971468 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:02.972309 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=7,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:02.978088 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:02.978567 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:02.979000 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:02.979717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:02.980172 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:02.980593 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:03.005345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lazy-loading 'flavor' on Instance uuid 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:13:03.074453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e5b647d-876c-49c1-a579-c8157091f951 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "POST /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8/action" status: 202 len: 0 microversion: 2.1 time: 0.109769 Sep 09 23:13:03.075028 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 539/1062] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:13:02 2022] POST /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:13:03.083575 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:03.084188 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:03.086332 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:03.087159 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=32 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:03.093023 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:03.093512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:03.093944 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:03.094656 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:03.095108 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:03.095551 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:03.226346 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:03.234067 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-74640702-bf8f-4e6e-b4c9-6f4f7095814d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.154628 Sep 09 23:13:03.234628 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 524/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:03 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:04.258762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:04.259463 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:04.265567 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:04.266052 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:04.266509 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:04.267196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:04.267710 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:04.268136 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:04.406218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:04.414839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72dc285d-147d-47b7-a62b-d3ebe3bf03cc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.160789 Sep 09 23:13:04.415403 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 540/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:04 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:05.438111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:05.438729 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:05.445890 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:05.446415 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:05.446853 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:05.447567 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:05.448029 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:05.448454 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:05.580082 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:05.587710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d20a1ec-a8dd-42ac-9265-bfe33b652a04 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.153553 Sep 09 23:13:05.588283 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 525/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:05 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:06.611558 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:06.612161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:06.618502 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:06.618979 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:06.619400 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:06.620114 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:06.620562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:06.620977 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:06.747872 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:06.755551 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6057144e-9f64-4610-b87a-3575ae53644b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.148520 Sep 09 23:13:06.756119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 541/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:06 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:07.778852 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:07.779466 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:07.785964 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:07.786447 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:07.786882 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:07.787598 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:07.788057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:07.788486 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:07.915555 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:07.923322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-07f1787e-206a-4b9e-b1de-b4dc9458e0f2 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.148301 Sep 09 23:13:07.923929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 526/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:07 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:08.950922 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:08.951562 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:08.958592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:08.959072 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:08.959526 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:08.960219 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:08.960671 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:08.961094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:09.096823 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:09.104557 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-56ff074b-37d5-4867-a4db-e17e21d4be41 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.157571 Sep 09 23:13:09.105119 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 542/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:08 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:10.128019 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:10.128771 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:10.135420 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:10.135929 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:10.136359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:10.137060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:10.137493 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:10.137912 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:10.267828 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:10.275602 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-263ba8d7-1c93-464b-8897-f7294a106cdc tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.151591 Sep 09 23:13:10.276286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 527/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:10 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:11.301076 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:11.301991 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:11.310025 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:11.310508 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:11.310946 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:11.311687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:11.312151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:11.312580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:11.443301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:11.450992 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d92fb1b-28a0-46c2-a43c-b45994a27425 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.155961 Sep 09 23:13:11.451578 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 543/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:11 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:12.474048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:12.474650 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:12.481025 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:12.481504 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:12.481942 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:12.482645 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:12.483084 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:12.483530 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:12.615482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:12.623259 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1db1226f-9f09-442b-b08f-c915d7563453 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.153114 Sep 09 23:13:12.623863 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 528/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:12 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:13.647560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:13.648219 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:13.655599 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:13.656009 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:13.656446 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:13.657152 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:13.657609 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:13.658038 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:13.790926 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:13.799344 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93fd1a87-28ad-4333-9a90-20102ebdc06b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.156245 Sep 09 23:13:13.799939 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 544/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:13 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:14.823276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:14.823865 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:14.830375 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:14.830862 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:14.831331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:14.832056 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:14.832523 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:14.832962 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:14.975777 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:14.986862 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a95840fb-1cd3-4a70-b414-e35d644194d6 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.167507 Sep 09 23:13:14.987456 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 529/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:14 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:16.009708 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:16.010345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:16.016800 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:16.017284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:16.017717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:16.018425 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:16.018986 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:16.019408 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:16.354675 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:16.362787 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3040a808-f324-46e7-8c31-22fb23f8f23c tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.356867 Sep 09 23:13:16.363350 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 545/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:16 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:17.386022 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:17.386651 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:17.393640 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:17.394114 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:17.394544 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:17.395223 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:17.395702 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:17.396123 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:17.527299 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:17.535599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08f6b753-b4c3-4eab-b89f-ac18dbcf1296 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1508 microversion: 2.1 time: 0.153393 Sep 09 23:13:17.536158 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 530/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:17 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:17.558486 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:17.559094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:17.565563 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:17.566057 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:17.566498 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:17.567197 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:17.567699 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:17.568131 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:17.596093 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120598) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 23:13:17.660540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bc4edf2-1da4-4034-a3dc-8ff6957890be tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "POST /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8/action" status: 202 len: 0 microversion: 2.1 time: 0.106145 Sep 09 23:13:17.661141 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 546/1076] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 23:13:17 2022] POST /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:13:17.669216 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:17.669831 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:17.676245 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:17.676736 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:17.677179 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:17.677874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:17.678332 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:17.678757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:17.812149 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:17.821334 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a95ffafb-44ce-4b6c-86a1-21bb5eaa3b63 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1516 microversion: 2.1 time: 0.155912 Sep 09 23:13:17.821899 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 531/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:17 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:13:18.844027 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:18.844556 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:18.850353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:18.850830 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:18.851262 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:18.851976 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:18.852432 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:18.852852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:18.983844 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:18.992295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-035cdd25-87b4-4fe5-b602-5d4ec162cdde tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1518 microversion: 2.1 time: 0.152817 Sep 09 23:13:18.992877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 547/1078] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:18 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:19.175881 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ac02a87a-c4b3-42d5-a02d-fd11b80bd16f req-95c1d5a3-adf1-4da7-9000-618e39ee537a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa1dfa7-90d0-4992-a5ba-90694d0c61a8", "name": "network-vif-unplugged", "status": "completed", "tag": "d6d1f015-bc7f-4e62-8e56-7e56e18dc3de"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:19.185858 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ac02a87a-c4b3-42d5-a02d-fd11b80bd16f req-95c1d5a3-adf1-4da7-9000-618e39ee537a service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:19.186351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ac02a87a-c4b3-42d5-a02d-fd11b80bd16f req-95c1d5a3-adf1-4da7-9000-618e39ee537a service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:19.186767 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ac02a87a-c4b3-42d5-a02d-fd11b80bd16f req-95c1d5a3-adf1-4da7-9000-618e39ee537a service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:19.198349 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.server_external_events [req-ac02a87a-c4b3-42d5-a02d-fd11b80bd16f req-95c1d5a3-adf1-4da7-9000-618e39ee537a service nova] Unable to find a host for instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8. Dropping event network-vif-unplugged {{(pid=120603) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 23:13:19.199233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ac02a87a-c4b3-42d5-a02d-fd11b80bd16f req-95c1d5a3-adf1-4da7-9000-618e39ee537a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027962 Sep 09 23:13:19.199856 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 532/1079] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 23:13:19.558875 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:19.561212 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:19.567056 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:19.567595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:19.568032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:19.568715 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:19.569169 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:19.569592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:19.601737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4605228c-a6d7-4f9e-8fbf-5e3ae869cf30 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046996 Sep 09 23:13:19.602452 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 548/1080] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:13:19 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:13:19.670940 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:19.671445 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:19.677755 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:19.678253 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:19.678696 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:19.679410 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:19.679902 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:19.680591 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:19.707840 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:13:19.791438 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5005c35-2468-4e1c-9395-c299c1533a6c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 204 len: 0 microversion: 2.1 time: 0.124031 Sep 09 23:13:19.792708 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 533/1081] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:13:19 2022] DELETE /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:13:19.801183 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:19.802286 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:19.808794 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:19.809284 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:19.809722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:19.810427 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:19.810878 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:19.811450 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:19.943767 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:19.951555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78c1b198-ae83-498d-a259-9f885da65637 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1671 microversion: 2.1 time: 0.154649 Sep 09 23:13:19.952127 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 549/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:19 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:20.020513 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:20.021211 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:20.027748 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:20.028233 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:20.028669 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:20.029351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:20.029803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:20.030224 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:20.161810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:20.169756 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-81bca080-7a7c-4bd6-97e9-0e80705fda7e tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.153623 Sep 09 23:13:20.170322 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 534/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:20 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:20.976141 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:20.976750 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:20.983096 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:20.983539 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:20.983980 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:20.984672 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:20.985115 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:20.985534 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:21.114094 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:21.121722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c3a558b9-bdae-4481-bd05-749e053fe98e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1671 microversion: 2.1 time: 0.149608 Sep 09 23:13:21.122283 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 550/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:20 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:21.193494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:21.194104 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:21.200391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:21.200894 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:21.201324 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:21.202028 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:21.202466 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:21.202889 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:21.334972 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:21.342798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-deda4a46-ab95-4769-a161-9e331a664f21 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.153125 Sep 09 23:13:21.343365 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 535/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:21 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:22.145929 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:22.146632 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:22.153146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:22.153637 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:22.154079 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:22.154779 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:22.155242 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:22.155711 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:22.285203 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:22.292970 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dcbb2eb4-f5d3-412b-9226-bae601f9bd7a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1671 microversion: 2.1 time: 0.151189 Sep 09 23:13:22.293547 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 551/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:22 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:13:22.366489 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:22.367106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:22.373437 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:22.373918 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:22.374351 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:22.375046 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:22.375569 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:22.375998 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:22.630719 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:22.638473 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c38a622-0ba6-4143-ba3b-28b9b6768b65 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.275943 Sep 09 23:13:22.639042 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 536/1087] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:22 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:13:23.085069 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-02b3dbac-686d-4e88-9639-57aa0c4d392e req-81adcef9-8ee7-4569-ab56-9fa583fefcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "450cc210-345e-42fa-9601-36d94a7ecf31", "name": "network-vif-deleted", "tag": "c4bbcb3b-d538-4851-9546-47e3cb74e228"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:23.102667 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02b3dbac-686d-4e88-9639-57aa0c4d392e req-81adcef9-8ee7-4569-ab56-9fa583fefcbc service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:23.103159 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02b3dbac-686d-4e88-9639-57aa0c4d392e req-81adcef9-8ee7-4569-ab56-9fa583fefcbc service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:23.103619 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02b3dbac-686d-4e88-9639-57aa0c4d392e req-81adcef9-8ee7-4569-ab56-9fa583fefcbc service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:23.121656 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-02b3dbac-686d-4e88-9639-57aa0c4d392e req-81adcef9-8ee7-4569-ab56-9fa583fefcbc service nova] Creating event network-vif-deleted:c4bbcb3b-d538-4851-9546-47e3cb74e228 for instance 450cc210-345e-42fa-9601-36d94a7ecf31 on hv-cinder-85221 Sep 09 23:13:23.127887 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-02b3dbac-686d-4e88-9639-57aa0c4d392e req-81adcef9-8ee7-4569-ab56-9fa583fefcbc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106065 Sep 09 23:13:23.129281 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 552/1088] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:13:23.318040 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:23.318688 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:23.324522 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:23.325004 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:23.325436 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:23.326122 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:23.326572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:23.326993 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:23.358579 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:23.359060 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:23.359508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:23.360459 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lazy-loading 'fault' on Instance uuid 450cc210-345e-42fa-9601-36d94a7ecf31 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:13:23.402279 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:23.409884 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54744833-af77-447a-a4a9-6bb40283a627 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 200 len: 1326 microversion: 2.1 time: 0.096410 Sep 09 23:13:23.410446 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 537/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:23 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:23.665157 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:23.665931 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:23.673343 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:23.674161 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:23.674749 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:23.675603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:23.676330 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:23.676766 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:23.681459 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:23.818716 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:23.826626 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-053ea2b5-0138-4c51-9cff-1c9aff48b104 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.167022 Sep 09 23:13:23.827280 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 553/1090] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:23 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:24.434000 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:24.434614 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:24.441452 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:24.441941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:24.442378 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:24.443067 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:24.443577 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:24.444008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:24.457941 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] HTTP exception thrown: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Request method failure captured: Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 HTTP/1.1 Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8fa46xymk6Pvis5Q8shqAhBFsR5rwFe2IOxGK1Mce329_TMPN59rHfYHhrVJi3CpNMP66pfZxZH2mUkbaMOCXAgNksufpb1bYCHGrOv1me2hBOnxqa5Bua-WwSZXU6lEGBflvetR2QwRRlHkVmIFG8_oj3yx9C149GKMqNsH0KAl34 Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:13:24.459623 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f319bdd0037244749fb635d82729b782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f319bdd0037244749fb635d82729b782", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 26bf037a0dd84ca9b46d8e2693de8bc4 Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:13:24.461297 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '450cc210-345e-42fa-9601-36d94a7ecf31'} Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:13:24.462286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:13:24.463682 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:13:24.464871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Returning 404 to user: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:13:24.464871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb441f94-b4fe-4718-8742-7eb56f8d0735 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 404 len: 111 microversion: 2.1 time: 0.031277 Sep 09 23:13:24.464871 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 538/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:24 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:13:24.469835 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28e6f3ea-9e25-46ce-8e82-6008568c9d0c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '.version_select at 0x7fcecf1ed3a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:24.488270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28e6f3ea-9e25-46ce-8e82-6008568c9d0c tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-412607382" status: 202 len: 0 microversion: 2.1 time: 0.022301 Sep 09 23:13:24.488817 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 554/1092] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 9 23:13:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-412607382 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:13:24.849446 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:24.850057 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:24.855904 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:24.856409 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:24.856895 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:24.857579 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:24.858024 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:24.858439 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:24.992313 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:24.995787 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:25.001237 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17962390-a94f-49e5-8f26-2672996c0a5f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.155684 Sep 09 23:13:25.001803 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 539/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:24 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:25.115884 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bc46c87-826a-4722-9418-c446cb5c04d3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'create', calling method: .version_select at 0x7fcecf3e1c10>, body: {"keypair": {"name": "tempest-keypair-1747155197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh55847r/63z8tXV9LFQUuf9lF8j2azK5AKnNSeh/p3BGXgTdnz+mIvDrFmv4d2sOhuuZgR/UrVK4DoQ0azIQaerKajXtS9uoHtJBxvB1JApzWn51gUgK69roteMVYgug=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:25.133664 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-7bc46c87-826a-4722-9418-c446cb5c04d3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Getting quotas for project f319bdd0037244749fb635d82729b782. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:13:25.137439 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-7bc46c87-826a-4722-9418-c446cb5c04d3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Getting quotas for user 26bf037a0dd84ca9b46d8e2693de8bc4 and project f319bdd0037244749fb635d82729b782. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:13:25.159762 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bc46c87-826a-4722-9418-c446cb5c04d3 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048401 Sep 09 23:13:25.160343 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 555/1094] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 23:13:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:13:26.025252 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:26.025869 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:26.033526 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:26.034023 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:26.034457 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:26.035154 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:26.035644 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:26.036071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:26.170331 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:26.178759 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38b00bff-2d18-42d4-8373-f3954e8f6063 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.158174 Sep 09 23:13:26.179337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 540/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:26 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:26.403531 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1198185283", "imageRef": "3e991153-f30c-4865-a82e-82499c5e1a74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ad3c4f1-128f-476d-83c6-d034333af424"}], "security_groups": [{"name": "tempest-securitygroup--1854668833"}], "key_name": "tempest-keypair-1747155197", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:26.505419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] validate_networks() for [('4ad3c4f1-128f-476d-83c6-d034333af424', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:13:26.921201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:13:26.921652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:13:26.922144 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:13:26.922536 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:13:26.922943 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:13:26.932106 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:26.932527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:26.932957 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:26.933679 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:26.934134 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:26.934554 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:26.950988 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Getting quotas for project f319bdd0037244749fb635d82729b782. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:13:26.955347 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Getting quotas for user 26bf037a0dd84ca9b46d8e2693de8bc4 and project f319bdd0037244749fb635d82729b782. Resources: {'cores', 'ram', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:13:26.966017 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:13:26.968622 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e991153-f30c-4865-a82e-82499c5e1a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:13:27.024752 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c90c470-bb3b-4855-8e72-8294778a7655 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.625775 Sep 09 23:13:27.025404 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 556/1096] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 23:13:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:13:27.036845 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba8f640d-286f-471a-bf21-8b39261a4148 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:27.037451 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba8f640d-286f-471a-bf21-8b39261a4148 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:27.091181 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba8f640d-286f-471a-bf21-8b39261a4148 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:27.098595 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba8f640d-286f-471a-bf21-8b39261a4148 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1238 microversion: 2.1 time: 0.065540 Sep 09 23:13:27.099148 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 541/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:27 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:27.202098 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:27.202735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:27.209248 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:27.209735 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:27.210175 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:27.210861 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:27.211317 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:27.211770 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:27.356798 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:27.364921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54490cd5-4df6-4e04-9864-aa28bd839c48 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.166781 Sep 09 23:13:27.365808 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 557/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:27 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:28.121146 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:28.121757 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:28.130145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:28.130639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:28.131071 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:28.131793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:28.132278 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:28.132700 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:28.196012 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:28.203722 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3295b04d-6c46-433d-8af6-f7f4b51befe6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1290 microversion: 2.1 time: 0.086523 Sep 09 23:13:28.204290 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 542/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:28 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:28.388337 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:28.388878 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:28.396019 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:28.396504 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:28.396944 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:28.397634 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:28.398091 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:28.398518 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:28.527108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:28.535301 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3df9d287-d9f0-4235-8771-60868efd2768 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.150938 Sep 09 23:13:28.535892 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 558/1100] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:28 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:29.226883 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:29.227733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:29.236184 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:29.236818 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:29.237356 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:29.238330 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:29.238888 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:29.239420 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:29.317680 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:29.325949 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-999c32d7-832a-4c84-9a0e-da86adec2e8a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1296 microversion: 2.1 time: 0.103207 Sep 09 23:13:29.326599 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 543/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:29 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:29.569932 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:29.571294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:29.591220 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:29.591835 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:29.592592 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:29.593376 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:29.594412 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:29.594910 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:29.754010 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:29.762961 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15b31217-a6b5-4764-b98d-ae6c4c39efdd tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.203391 Sep 09 23:13:29.764176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 559/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:29 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:30.206391 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-51c7d94b-bfa4-4ec7-8c50-49c347988863 req-76ca619d-ff3b-4f3d-9184-112d80bdfb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb023b27-75b5-4270-88ba-cdda4a6f1a0e", "tag": "fb76ddb2-7033-4a57-a635-f59b8e5cbf60"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:30.220141 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51c7d94b-bfa4-4ec7-8c50-49c347988863 req-76ca619d-ff3b-4f3d-9184-112d80bdfb78 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:30.220796 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51c7d94b-bfa4-4ec7-8c50-49c347988863 req-76ca619d-ff3b-4f3d-9184-112d80bdfb78 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:30.221348 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51c7d94b-bfa4-4ec7-8c50-49c347988863 req-76ca619d-ff3b-4f3d-9184-112d80bdfb78 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:30.233006 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-51c7d94b-bfa4-4ec7-8c50-49c347988863 req-76ca619d-ff3b-4f3d-9184-112d80bdfb78 service nova] Creating event network-changed:fb76ddb2-7033-4a57-a635-f59b8e5cbf60 for instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e on hv-cinder-85221 Sep 09 23:13:30.238433 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-51c7d94b-bfa4-4ec7-8c50-49c347988863 req-76ca619d-ff3b-4f3d-9184-112d80bdfb78 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037961 Sep 09 23:13:30.239020 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 544/1103] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:13:30.349359 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:30.350054 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:30.356267 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:30.356680 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:30.357151 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:30.357877 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:30.358371 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:30.358829 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:30.487911 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:30.495643 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ea92587-8044-4803-9ff5-159f849d4ed9 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1364 microversion: 2.1 time: 0.150257 Sep 09 23:13:30.496307 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 560/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:30 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:30.787461 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:30.788194 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:30.794290 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:30.794782 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:30.795212 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:30.795930 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:30.796383 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:30.796813 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:30.928868 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:30.936793 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b6ab1b4-1bbb-4652-840a-ea769143439a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.153708 Sep 09 23:13:30.937363 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 545/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:30 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:31.301382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-049f7f53-20d1-4a5b-b28c-eae30f96aa8a req-9009bbe6-b2fe-4d7a-ba3d-4a7d313c3b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa1dfa7-90d0-4992-a5ba-90694d0c61a8", "name": "network-vif-plugged", "status": "completed", "tag": "d6d1f015-bc7f-4e62-8e56-7e56e18dc3de"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:31.312322 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-049f7f53-20d1-4a5b-b28c-eae30f96aa8a req-9009bbe6-b2fe-4d7a-ba3d-4a7d313c3b1c service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:31.313294 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-049f7f53-20d1-4a5b-b28c-eae30f96aa8a req-9009bbe6-b2fe-4d7a-ba3d-4a7d313c3b1c service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:31.313727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-049f7f53-20d1-4a5b-b28c-eae30f96aa8a req-9009bbe6-b2fe-4d7a-ba3d-4a7d313c3b1c service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:31.324874 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-049f7f53-20d1-4a5b-b28c-eae30f96aa8a req-9009bbe6-b2fe-4d7a-ba3d-4a7d313c3b1c service nova] Creating event network-vif-plugged:d6d1f015-bc7f-4e62-8e56-7e56e18dc3de for instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 on hv-cinder-85221 Sep 09 23:13:31.330723 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-049f7f53-20d1-4a5b-b28c-eae30f96aa8a req-9009bbe6-b2fe-4d7a-ba3d-4a7d313c3b1c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092304 Sep 09 23:13:31.331315 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 561/1106] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:13:31.518121 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:31.518733 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:31.525158 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:31.525639 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:31.526069 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:31.526763 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:31.527205 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:31.527709 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:31.790839 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:31.799479 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04358733-81f9-4173-aeff-f10bd6f96548 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1364 microversion: 2.1 time: 0.285171 Sep 09 23:13:31.800252 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 546/1107] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:31 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:31.960527 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:31.961218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:31.967266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:31.967774 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:31.968206 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:31.968884 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:31.969353 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:31.970268 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:32.098882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:32.106624 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72e4df00-87b2-4904-91be-94d5170bf31f tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1574 microversion: 2.1 time: 0.150283 Sep 09 23:13:32.107388 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 562/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:31 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:32.822337 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:32.822879 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:32.830189 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:32.830674 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:32.831106 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:32.831824 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:32.832286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:32.832712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:32.959812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:32.967445 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a73c1c69-f6a4-4320-8387-dc7f18e24700 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1364 microversion: 2.1 time: 0.149162 Sep 09 23:13:32.968055 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 547/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:32 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:33.130383 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:33.130992 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:33.133446 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:33.138687 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:33.139172 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:33.139633 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:33.140332 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:33.140789 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:33.141211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:33.291821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:33.300882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22de6ef4-5055-4e5f-8390-a4ee098403f0 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1561 microversion: 2.1 time: 0.175002 Sep 09 23:13:33.301456 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 563/1110] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:33 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:33.990674 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:33.991217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:33.993635 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:33.998888 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:33.999374 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:33.999840 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:34.000541 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:34.000997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:34.001427 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:34.131421 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:34.138885 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f735340f-fe45-41ff-aa50-be38bdb138b7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1364 microversion: 2.1 time: 0.152129 Sep 09 23:13:34.139456 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 548/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:33 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:35.161594 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:35.162248 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:35.168536 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:35.169024 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:35.169457 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:35.170146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:35.170595 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:35.171014 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:35.283547 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1affcd7f-f30f-4e03-8a94-25bcb6bb0ab7 req-8e2bbafe-8754-45e5-a974-a7dfe6864f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb023b27-75b5-4270-88ba-cdda4a6f1a0e", "name": "network-vif-plugged", "status": "completed", "tag": "fb76ddb2-7033-4a57-a635-f59b8e5cbf60"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:35.296178 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1affcd7f-f30f-4e03-8a94-25bcb6bb0ab7 req-8e2bbafe-8754-45e5-a974-a7dfe6864f36 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:35.296452 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1affcd7f-f30f-4e03-8a94-25bcb6bb0ab7 req-8e2bbafe-8754-45e5-a974-a7dfe6864f36 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:35.296983 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1affcd7f-f30f-4e03-8a94-25bcb6bb0ab7 req-8e2bbafe-8754-45e5-a974-a7dfe6864f36 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:35.309747 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:35.310298 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1affcd7f-f30f-4e03-8a94-25bcb6bb0ab7 req-8e2bbafe-8754-45e5-a974-a7dfe6864f36 service nova] Creating event network-vif-plugged:fb76ddb2-7033-4a57-a635-f59b8e5cbf60 for instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e on hv-cinder-85221 Sep 09 23:13:35.316083 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1affcd7f-f30f-4e03-8a94-25bcb6bb0ab7 req-8e2bbafe-8754-45e5-a974-a7dfe6864f36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037141 Sep 09 23:13:35.317276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 549/1112] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:13:35.318460 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a507e34-9424-428f-9b3e-5548cc3742e7 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1364 microversion: 2.1 time: 0.160742 Sep 09 23:13:35.319036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 564/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:35 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:36.346567 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:36.347281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:36.353407 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:36.353881 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:36.354313 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:36.354994 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:36.355441 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:36.355891 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:36.484419 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:36.491960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6059a3b8-b3b2-4134-961f-21a09ae39c47 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1364 microversion: 2.1 time: 0.150241 Sep 09 23:13:36.492535 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 550/1114] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:36 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:37.514130 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:37.514742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:37.517560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:37.518336 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:37.523901 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:37.524382 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:37.524819 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:37.525506 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:37.525960 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:37.526386 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:37.655898 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:13:37.664201 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25fd1f93-e0ab-4bd7-aa65-8c02b1b889a6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1549 microversion: 2.1 time: 0.153949 Sep 09 23:13:37.664781 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 565/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:13:37 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:37.686048 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:37.686556 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:13:37.688506 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:37.694442 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:37.694933 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:37.695371 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:37.696092 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:37.696550 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:37.696978 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:37.773812 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72b0fe16-8eaf-413c-8c1a-3a586d0f3b3d tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091585 Sep 09 23:13:37.774410 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 551/1116] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 23:13:37 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:13:38.946522 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-37dd6727-5899-425f-8da7-dd4dd1174df1 req-6009eda0-1342-42c4-9661-bf895fbb3fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb023b27-75b5-4270-88ba-cdda4a6f1a0e", "tag": "fb76ddb2-7033-4a57-a635-f59b8e5cbf60"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:38.957821 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37dd6727-5899-425f-8da7-dd4dd1174df1 req-6009eda0-1342-42c4-9661-bf895fbb3fa2 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:13:38.958304 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37dd6727-5899-425f-8da7-dd4dd1174df1 req-6009eda0-1342-42c4-9661-bf895fbb3fa2 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:13:38.958737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37dd6727-5899-425f-8da7-dd4dd1174df1 req-6009eda0-1342-42c4-9661-bf895fbb3fa2 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:13:38.970530 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-37dd6727-5899-425f-8da7-dd4dd1174df1 req-6009eda0-1342-42c4-9661-bf895fbb3fa2 service nova] Creating event network-changed:fb76ddb2-7033-4a57-a635-f59b8e5cbf60 for instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e on hv-cinder-85221 Sep 09 23:13:38.975616 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-37dd6727-5899-425f-8da7-dd4dd1174df1 req-6009eda0-1342-42c4-9661-bf895fbb3fa2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032748 Sep 09 23:13:38.976507 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 566/1117] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:14.738397 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:14.739235 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=56 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:14.743823 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:14.744339 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:14.750874 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:14.751354 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:14.751832 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:14.753040 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:14.753528 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:14.754137 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:14.780175 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14e35bdb-1630-402e-84e7-1365a5e6b7e2 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/ips" status: 200 len: 145 microversion: 2.1 time: 0.043189 Sep 09 23:14:14.780734 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 552/1118] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 23:14:14 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:16.101560 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=7 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:16.102291 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=58 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:16.106540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ba44966-b675-4b66-95e0-81af09e92fdb"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:16.108974 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:16.115731 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:16.116218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:16.116652 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:16.117339 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:16.117799 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:16.118222 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:16.381511 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02220e63-7110-4392-9b9c-08fbb7e1047f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281460 Sep 09 23:14:16.382122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 567/1119] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:14:16 2022] POST /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:23.029931 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:23.032124 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:23.039022 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:23.039560 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:23.040024 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:23.040712 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:23.041226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:23.041657 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:23.070364 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff6c65de-1631-47e3-a3bf-0c8cdb1b85b4 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Sep 09 23:14:23.070911 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 553/1120] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:14:23 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:23.083282 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:23.083894 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:23.090097 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:23.090572 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:23.091001 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:23.091742 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:23.092196 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:23.092615 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:23.120679 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e12f6976-c61c-4aea-9c0a-a4232b711a40 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/5ba44966-b675-4b66-95e0-81af09e92fdb" status: 200 len: 194 microversion: 2.1 time: 0.042936 Sep 09 23:14:23.121249 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 568/1121] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 9 23:14:23 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/5ba44966-b675-4b66-95e0-81af09e92fdb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:24.450686 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4586f40f-c47b-400e-811f-e203bf3939eb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:24.453076 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:24.459701 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:24.460183 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:24.460619 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:24.461303 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:24.461756 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:24.462178 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:24.722180 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1d289c5-60f3-4703-85d1-3e4497e70425 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "POST /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274677 Sep 09 23:14:24.728182 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 554/1122] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 23:14:24 2022] POST /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:32.251429 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:32.253726 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:32.260668 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:32.261148 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:32.261580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:32.262270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:32.262722 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:32.263141 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:32.293036 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9dae1eed-169c-4aed-a68a-de92924a8f43 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045601 Sep 09 23:14:32.293582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 569/1123] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:14:32 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:32.433217 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:32.433753 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:32.439872 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:32.440843 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:32.441275 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:32.441959 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:32.442413 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:32.442836 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:32.472562 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-323b6fbc-8143-428c-87c8-375d6912891f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/5ba44966-b675-4b66-95e0-81af09e92fdb" status: 200 len: 194 microversion: 2.1 time: 0.044638 Sep 09 23:14:32.473130 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 555/1124] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 9 23:14:32 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/5ba44966-b675-4b66-95e0-81af09e92fdb => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:32.484339 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:32.484826 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:32.490635 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:32.491108 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:32.491568 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:32.492253 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:32.492705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:32.493123 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:32.573570 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lazy-loading 'services' on Instance uuid eb023b27-75b5-4270-88ba-cdda4a6f1a0e {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:14:32.644055 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72595a73-534f-4034-8a15-110f60592944 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/5ba44966-b675-4b66-95e0-81af09e92fdb" status: 202 len: 0 microversion: 2.1 time: 0.163396 Sep 09 23:14:32.644651 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 570/1125] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:14:32 2022] DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/5ba44966-b675-4b66-95e0-81af09e92fdb => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:14:33.769990 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:33.770528 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:33.776855 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:33.777338 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:33.777798 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:33.778482 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:33.778934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:33.779356 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:33.807906 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1083f01b-a380-47ee-b8f6-ede9f8272e38 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/4586f40f-c47b-400e-811f-e203bf3939eb" status: 200 len: 194 microversion: 2.1 time: 0.041926 Sep 09 23:14:33.808477 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 556/1126] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 9 23:14:33 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/4586f40f-c47b-400e-811f-e203bf3939eb => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:33.820596 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:33.821189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:33.827297 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:33.827825 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:33.828269 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:33.828963 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:33.829426 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:33.829852 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:33.911360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lazy-loading 'services' on Instance uuid eb023b27-75b5-4270-88ba-cdda4a6f1a0e {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:14:33.979697 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fd11176-7637-426c-ab61-c47e2b7a95f6 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/4586f40f-c47b-400e-811f-e203bf3939eb" status: 202 len: 0 microversion: 2.1 time: 0.164327 Sep 09 23:14:33.980266 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 571/1127] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 23:14:33 2022] DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments/4586f40f-c47b-400e-811f-e203bf3939eb => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:14:35.148145 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:35.150401 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:35.156795 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:35.157276 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:35.157710 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:35.158399 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:35.158860 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:35.159922 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:35.188226 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ec5af58-1fc0-4952-9a21-42442996a519 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044595 Sep 09 23:14:35.188769 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 557/1128] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:14:35 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 23:14:35.305672 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:35.307979 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:35.314052 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:35.314533 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:35.314968 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:35.315717 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:35.316176 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:35.316612 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:35.345064 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6346f258-72bf-40da-a7ed-bb9a24968a03 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044500 Sep 09 23:14:35.345611 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 572/1129] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 23:14:35 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:14:35.407964 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:35.408453 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:35.414388 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:35.414861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:35.415291 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:35.416005 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:35.416458 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:35.416877 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:35.442286 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:14:35.516779 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ce169e8-5a1e-491a-a1ce-87c23c693cbf tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 204 len: 0 microversion: 2.1 time: 0.112452 Sep 09 23:14:35.517369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 558/1130] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:14:35 2022] DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:14:35.526603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:35.527235 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:35.533117 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:35.533603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:35.534040 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:35.535219 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:35.535705 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:35.536131 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:35.665882 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:14:35.673559 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c6c71d0-2ae8-458c-9753-991e68da2b9f tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1674 microversion: 2.1 time: 0.150918 Sep 09 23:14:35.674122 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 573/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:35 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:36.700923 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:36.701604 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:36.708461 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:36.708938 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:36.709369 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:36.710058 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:36.710512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:36.710935 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:36.846549 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:14:36.854875 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f318504-cd6e-4d40-9ac7-fb0a5af26961 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1674 microversion: 2.1 time: 0.160564 Sep 09 23:14:36.855439 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 559/1132] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:36 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:37.879168 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:37.879807 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:37.886138 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:37.886629 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:37.887068 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:37.887795 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:37.888253 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:37.888684 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:37.951580 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf037a0dd84ca9b46d8e2693de8bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f319bdd0037244749fb635d82729b782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:14:37.960360 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c86cc07-4668-43a7-a43b-b5f1067b4b72 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 200 len: 1606 microversion: 2.1 time: 0.086001 Sep 09 23:14:37.960939 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 574/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:37 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 1606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:38.251248 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-416a7bca-9a86-4477-8398-708f5c4a9bae req-00d422e8-96d1-48ad-a563-3e7c6495effa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb023b27-75b5-4270-88ba-cdda4a6f1a0e", "name": "network-vif-deleted", "tag": "fb76ddb2-7033-4a57-a635-f59b8e5cbf60"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:38.261939 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-416a7bca-9a86-4477-8398-708f5c4a9bae req-00d422e8-96d1-48ad-a563-3e7c6495effa service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:38.262444 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-416a7bca-9a86-4477-8398-708f5c4a9bae req-00d422e8-96d1-48ad-a563-3e7c6495effa service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:38.262866 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-416a7bca-9a86-4477-8398-708f5c4a9bae req-00d422e8-96d1-48ad-a563-3e7c6495effa service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:38.274222 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-416a7bca-9a86-4477-8398-708f5c4a9bae req-00d422e8-96d1-48ad-a563-3e7c6495effa service nova] Creating event network-vif-deleted:fb76ddb2-7033-4a57-a635-f59b8e5cbf60 for instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e on hv-cinder-85221 Sep 09 23:14:38.279335 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-416a7bca-9a86-4477-8398-708f5c4a9bae req-00d422e8-96d1-48ad-a563-3e7c6495effa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031909 Sep 09 23:14:38.280510 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 560/1134] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:38.985136 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:38.985739 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:38.992443 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:38.993211 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:38.993591 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:38.994295 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:38.994755 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:38.995189 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:39.009049 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] HTTP exception thrown: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Request method failure captured: Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e HTTP/1.1 Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8fa46xymk6Pvis5Q8shqAhBFsR5rwFe2IOxGK1Mce329_TMPN59rHfYHhrVJi3CpNMP66pfZxZH2mUkbaMOCXAgNksufpb1bYCHGrOv1me2hBOnxqa5Bua-WwSZXU6lEGBflvetR2QwRRlHkVmIFG8_oj3yx9C149GKMqNsH0KAl34 Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:14:39.010727 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f319bdd0037244749fb635d82729b782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f319bdd0037244749fb635d82729b782", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 26bf037a0dd84ca9b46d8e2693de8bc4 Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:39.012529 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'eb023b27-75b5-4270-88ba-cdda4a6f1a0e'} Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:39.013678 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:39.015310 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:39.016923 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Returning 404 to user: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:39.016923 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98374226-5d50-45ab-8452-713d0c67cca8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 404 len: 111 microversion: 2.1 time: 0.030982 Sep 09 23:14:39.016923 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 575/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:38 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:14:39.022231 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac982c8e-675d-4194-99be-61f372a4690e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '.version_select at 0x7fcecf48a9d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:39.044918 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac982c8e-675d-4194-99be-61f372a4690e tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747155197" status: 202 len: 0 microversion: 2.1 time: 0.027330 Sep 09 23:14:39.045494 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 561/1136] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 9 23:14:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747155197 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:14:42.401345 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:42.401839 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:42.408453 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:42.409428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:42.409867 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:42.410555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:42.411013 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:42.411442 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:42.424455 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] HTTP exception thrown: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Request method failure captured: Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e HTTP/1.1 Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8fa46xymk6Pvis5Q8shqAhBFsR5rwFe2IOxGK1Mce329_TMPN59rHfYHhrVJi3CpNMP66pfZxZH2mUkbaMOCXAgNksufpb1bYCHGrOv1me2hBOnxqa5Bua-WwSZXU6lEGBflvetR2QwRRlHkVmIFG8_oj3yx9C149GKMqNsH0KAl34 Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:14:42.426555 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f319bdd0037244749fb635d82729b782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f319bdd0037244749fb635d82729b782", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 26bf037a0dd84ca9b46d8e2693de8bc4 Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.428270 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': 'eb023b27-75b5-4270-88ba-cdda4a6f1a0e'} Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:42.429095 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.430428 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.432378 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Returning 404 to user: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:42.432378 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d0734e5-d362-47b4-9330-f4e343b541b8 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 404 len: 111 microversion: 2.1 time: 0.030413 Sep 09 23:14:42.432378 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 576/1137] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:14:42 2022] DELETE /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:14:42.436422 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:42.437150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: eb023b27-75b5-4270-88ba-cdda4a6f1a0e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:42.444250 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:42.444725 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:42.445156 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:42.445833 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:42.446281 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:42.446699 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:42.459352 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] HTTP exception thrown: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Request method failure captured: Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e HTTP/1.1 Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8fa46xymk6Pvis5Q8shqAhBFsR5rwFe2IOxGK1Mce329_TMPN59rHfYHhrVJi3CpNMP66pfZxZH2mUkbaMOCXAgNksufpb1bYCHGrOv1me2hBOnxqa5Bua-WwSZXU6lEGBflvetR2QwRRlHkVmIFG8_oj3yx9C149GKMqNsH0KAl34 Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:14:42.460967 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f319bdd0037244749fb635d82729b782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f319bdd0037244749fb635d82729b782", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 26bf037a0dd84ca9b46d8e2693de8bc4 Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.462692 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': 'eb023b27-75b5-4270-88ba-cdda4a6f1a0e'} Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:42.463844 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. Sep 09 23:14:42.465512 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:42.467008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Returning 404 to user: Instance eb023b27-75b5-4270-88ba-cdda4a6f1a0e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:42.467008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-98ffc007-3dbd-4a60-a46e-03f21e291d96 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e" status: 404 len: 111 microversion: 2.1 time: 0.029737 Sep 09 23:14:42.467008 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 562/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:42 2022] GET /compute/v2.1/servers/eb023b27-75b5-4270-88ba-cdda4a6f1a0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:14:43.599048 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:43.599598 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:43.605801 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:43.606275 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:43.606708 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:43.607387 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:43.607878 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:43.608299 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:43.621632 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] HTTP exception thrown: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Request method failure captured: Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 HTTP/1.1 Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8fa46xymk6Pvis5Q8shqAhBFsR5rwFe2IOxGK1Mce329_TMPN59rHfYHhrVJi3CpNMP66pfZxZH2mUkbaMOCXAgNksufpb1bYCHGrOv1me2hBOnxqa5Bua-WwSZXU6lEGBflvetR2QwRRlHkVmIFG8_oj3yx9C149GKMqNsH0KAl34 Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:14:43.623162 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f319bdd0037244749fb635d82729b782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f319bdd0037244749fb635d82729b782", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: 26bf037a0dd84ca9b46d8e2693de8bc4 Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.625051 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '450cc210-345e-42fa-9601-36d94a7ecf31'} Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:43.626063 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.628405 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.630054 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Returning 404 to user: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:43.630054 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ddd88ec-d256-497e-9efc-55bf53921f2a tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "DELETE /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 404 len: 111 microversion: 2.1 time: 0.029325 Sep 09 23:14:43.630054 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 577/1139] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:14:43 2022] DELETE /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:14:43.633359 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:43.633959 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] [instance: 450cc210-345e-42fa-9601-36d94a7ecf31] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:43.640589 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:43.641072 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:43.641508 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:43.642204 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:43.642663 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:43.643097 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:43.660671 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] HTTP exception thrown: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Request method failure captured: Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 HTTP/1.1 Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Connection: close Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Host: 10.222.0.17 Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjG8fa46xymk6Pvis5Q8shqAhBFsR5rwFe2IOxGK1Mce329_TMPN59rHfYHhrVJi3CpNMP66pfZxZH2mUkbaMOCXAgNksufpb1bYCHGrOv1me2hBOnxqa5Bua-WwSZXU6lEGBflvetR2QwRRlHkVmIFG8_oj3yx9C149GKMqNsH0KAl34 Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 09 23:14:43.662230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f319bdd0037244749fb635d82729b782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f319bdd0037244749fb635d82729b782", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f319bdd0037244749fb635d82729b782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Id: f319bdd0037244749fb635d82729b782 Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-445200881 Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Id: 26bf037a0dd84ca9b46d8e2693de8bc4 Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-445200881-project Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: method: > Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: exception: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.663960 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: action_args: {'id': '450cc210-345e-42fa-9601-36d94a7ecf31'} Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:43.664861 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. Sep 09 23:14:43.666264 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 09 23:14:43.667572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] Returning 404 to user: Instance 450cc210-345e-42fa-9601-36d94a7ecf31 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:43.667572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-991d0a44-283e-4fa4-8d05-9b1881aa6898 tempest-AttachVolumeTestJSON-445200881 tempest-AttachVolumeTestJSON-445200881-project] 10.222.0.17 "GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31" status: 404 len: 111 microversion: 2.1 time: 0.034095 Sep 09 23:14:43.667572 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 563/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:43 2022] GET /compute/v2.1/servers/450cc210-345e-42fa-9601-36d94a7ecf31 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:14:47.994488 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:47.995004 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:47.998493 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=23 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:48.005257 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:48.009165 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:48.009682 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:48.012476 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:48.012788 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:48.013218 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:48.049098 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:48.054572 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:14:48.161029 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b59cd47-aedb-4a43-9f0f-7825738d4a5a tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 204 len: 0 microversion: 2.1 time: 0.169749 Sep 09 23:14:48.162047 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 578/1141] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 23:14:47 2022] DELETE /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:14:48.173104 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:48.175080 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:48.182638 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:48.183419 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:48.184146 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:48.185173 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:48.186121 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:48.186711 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:48.251810 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b3641936-4543-4347-952f-08e84c68b678 req-672e957d-cb4d-4e41-b77e-c802099d488b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa1dfa7-90d0-4992-a5ba-90694d0c61a8", "tag": "d6d1f015-bc7f-4e62-8e56-7e56e18dc3de"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:48.262295 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:48.265007 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b3641936-4543-4347-952f-08e84c68b678 req-672e957d-cb4d-4e41-b77e-c802099d488b service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:48.265961 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b3641936-4543-4347-952f-08e84c68b678 req-672e957d-cb4d-4e41-b77e-c802099d488b service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:48.266773 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b3641936-4543-4347-952f-08e84c68b678 req-672e957d-cb4d-4e41-b77e-c802099d488b service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:48.279997 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:48.286450 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b3641936-4543-4347-952f-08e84c68b678 req-672e957d-cb4d-4e41-b77e-c802099d488b service nova] Creating event network-changed:d6d1f015-bc7f-4e62-8e56-7e56e18dc3de for instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 on hv-cinder-85221 Sep 09 23:14:48.294746 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b3641936-4543-4347-952f-08e84c68b678 req-672e957d-cb4d-4e41-b77e-c802099d488b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297799 Sep 09 23:14:48.296166 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 564/1142] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:14:48.351283 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:14:48.359702 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e7244aa-301e-457a-8200-78a09bd3fc2d tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.191660 Sep 09 23:14:48.366248 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 579/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:48 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:49.385934 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:49.386627 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:49.393614 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:49.394088 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:49.394517 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:49.395230 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:49.395721 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:49.396141 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:49.598333 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:14:49.606166 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-453ed600-4683-4b80-b336-5e614da8697b tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1567 microversion: 2.1 time: 0.225251 Sep 09 23:14:49.606737 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 565/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:49 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:50.629858 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:50.630471 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:50.636680 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:50.637168 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:50.637603 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:50.638290 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:50.638741 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:50.639163 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:50.706625 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b339e5581cf044d9a55eb85561a58106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68efb39c9f649d6a0e2bc424b418cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:14:50.716730 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c37e333-5162-4e6e-a164-a34038f8a4b5 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 200 len: 1381 microversion: 2.1 time: 0.090615 Sep 09 23:14:50.717662 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 580/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:50 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 1381 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:50.742975 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c6b9dedb-f8e8-4313-b2f1-5dd016af5ba2 req-6f55f087-1ccd-42d1-9c7c-20d2c7c5b2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa1dfa7-90d0-4992-a5ba-90694d0c61a8", "name": "network-vif-deleted", "tag": "d6d1f015-bc7f-4e62-8e56-7e56e18dc3de"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:50.753660 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6b9dedb-f8e8-4313-b2f1-5dd016af5ba2 req-6f55f087-1ccd-42d1-9c7c-20d2c7c5b2e3 service nova] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:50.754150 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6b9dedb-f8e8-4313-b2f1-5dd016af5ba2 req-6f55f087-1ccd-42d1-9c7c-20d2c7c5b2e3 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:50.754583 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6b9dedb-f8e8-4313-b2f1-5dd016af5ba2 req-6f55f087-1ccd-42d1-9c7c-20d2c7c5b2e3 service nova] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:50.765456 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c6b9dedb-f8e8-4313-b2f1-5dd016af5ba2 req-6f55f087-1ccd-42d1-9c7c-20d2c7c5b2e3 service nova] Creating event network-vif-deleted:d6d1f015-bc7f-4e62-8e56-7e56e18dc3de for instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 on hv-cinder-85221 Sep 09 23:14:50.771534 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c6b9dedb-f8e8-4313-b2f1-5dd016af5ba2 req-6f55f087-1ccd-42d1-9c7c-20d2c7c5b2e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Sep 09 23:14:50.772131 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 566/1146] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 23:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:51.740540 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:51.741194 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] [instance: 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:14:51.747582 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:51.748065 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:51.748521 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:51.749213 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Acquiring lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:14:51.749672 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:14:51.750098 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Lock "a993bcac-a3a9-4583-94c3-ba20b13e6175" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:14:51.763259 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] HTTP exception thrown: Instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 could not be found. Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Request method failure captured: Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 HTTP/1.1 Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept: application/json Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Connection: close Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Length: 0 Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Content-Type: application/json Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Host: 10.222.0.17 Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjG8fNlh5QNX42C-Vk__RragAppwoWeQ5mmc3xhg_nVplsvWm8Zt6w2g4oJw7Hbr2GXYnqfOTu1MI528kmmmb-r_JsZ2PaU-ipS033lREw0RO28vFGgZGeljkH4LCFcCeT6dix1XHeKMki7Yj0LIZinH69M4y_0oBz70EKKvr4ttsQHG0 Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Id: f68efb39c9f649d6a0e2bc424b418cbd Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestShelveInstance-1896546634 Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Role: reader,member Sep 09 23:14:51.764921 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f68efb39c9f649d6a0e2bc424b418cbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f68efb39c9f649d6a0e2bc424b418cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f68efb39c9f649d6a0e2bc424b418cbd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f68efb39c9f649d6a0e2bc424b418cbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestShelveInstance-1896546634 Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Id: f68efb39c9f649d6a0e2bc424b418cbd Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestShelveInstance-1896546634 Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User: tempest-TestShelveInstance-1896546634-project Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Id: b339e5581cf044d9a55eb85561a58106 Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestShelveInstance-1896546634-project Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: method: > Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: exception: Instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 could not be found. Sep 09 23:14:51.766737 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: action_args: {'id': '4aa1dfa7-90d0-4992-a5ba-90694d0c61a8'} Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 could not be found. Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:51.767815 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 could not be found. Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 could not be found. Sep 09 23:14:51.770032 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.771566 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Returning 404 to user: Instance 4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:51.771566 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3e59b48b-6ca7-44fd-9489-3623391780d9 tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8" status: 404 len: 111 microversion: 2.1 time: 0.029773 Sep 09 23:14:51.771566 dv-cinder-852211-14-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 581/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 23:14:51 2022] GET /compute/v2.1/servers/4aa1dfa7-90d0-4992-a5ba-90694d0c61a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:14:51.936047 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25c38411-89b7-4aa1-9f54-8ac7d406c2aa tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] Calling method '.version_select at 0x7fcecf459040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:51.956329 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25c38411-89b7-4aa1-9f54-8ac7d406c2aa tempest-TestShelveInstance-1896546634 tempest-TestShelveInstance-1896546634-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-629369020" status: 202 len: 0 microversion: 2.1 time: 0.024350 Sep 09 23:14:51.957111 dv-cinder-852211-14-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 567/1148] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 23:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-629369020 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)